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ABSTRACT 



In 1990, the National Assessment of Educational Progress 
(NAEP) included a Trial State Assessment (TSA) ; for the first time in NAEP’s 
history, voluntary state-by-state assessments were made. In 1994, TSA was 
expanded to include non-public school students. The 1994 reading assessment 
considered students 1 proficiency in situations that involved reading 
different kinds of materials for different purposes. The fourth-grade 
assessment measured two global purposes for reading- - reading for literary 
experience and reading to gain information. In Louisiana, 2,713 students in 
103 public schools and 457 students in 19 non-public schools were assessed. 
This report describes the reading proficiency of Louisiana fourth-graders and 
compares their overall performance to students in the Southeast region of the 
United States and the nation (using data from the NAEP national assessments) . 
The distribution of reading results and reading achievement level results are 
provided for subpopulations of students (race/ethnicity, type of location, 
parents, educational level, and gender) . Reading proficiency and achievement 
of non-public school students are separately reported and compared to public 
school students. To provide a context for the assessment data, participating 
public school students, their reading teachers, and principals completed 
questionnaires which focused on: policies and practices related to reading 
(time for instructional activities and instructional resources for reading) ; 
delivery of reading instruction (instructional materials and activities, 
workbooks/ worksheets/writing, discussion and group activities, time to read, 
reading and use of libraries, assessing progress in reading); reading 
instructors (preparation, experience and professional development); students 1 
home support for literacy (reading outside of school and in the home and 
hours of television watched per day) . The average reading proficiency of 
fourth-grade public school students in Louisiana on the NAEP reading scale 
was 197 compared to 212 nationwide. (SR) 



What is The Nation’s Report Card? 



THE NATION'S REPORT CARD, the National Assessment of Educational Progress (NAEP), is the only nationally representative and continuing 
assessment of what America's students know and can do in various subject areas. Since 1969, assessments have been conducted periodically in 
reading, mathematics, science, writing, history/geography, and other fields. By making objective information on student performance available to 
policymakers at the national, state, and local levels, NAEP is an integral part of our nation's evaluation of the condition and progress of education. 
Only information related to academic achievement is collected under this program. NAEP guarantees the privacy of individual students and their 
families. 

NAEP is a congressionally mandated project of the National Center for Education Statistics, the U.S. Department of Education. The 
Commissioner of Education Statistics is responsible, by law, for carrying out the NAEP project through competitive awards to qualified organiza- 
tions. NAEP reports directly to the Commissioner, who is also responsible for providing continuing reviews, including validation studies and 
solicitation of public comment, on NAEP's conduct and usefulness. 

In 1988, Congress established the National Assessment Governing Board (NAGB) to formulate policy guidelines for NAEP. The Board is 
responsible for selecting the subject areas to be assessed from among those included in the National Education Goals; for setting appropriate student 
performance levels; for developing assessment objectives and test specifications through a national consensus approach; for designing the 
assessment methodology; for developing guidelines for reporting and disseminating NAEP results; for developing standards and procedures for 
interstate, regional, and national comparisons; for determining the appropriateness of test items and ensuring they are free from bias; and for taking 
actions to improve the form and use of the National Assessment. 
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EXECUTIVE 

SUMMARY 



In 1988, Congress passed legislation for the National Assessment of Educational 
Progress (NAEP) that continued its primary mission of providing dependable and 
comprehensive information about educational progress in the United States. In addition, 
for the first time in the project’s history, the legislation also included a provision 
authorizing voluntary state-by-state assessments on a trial basis. 

As a result of the legislation, the 1990 NAEP program included a Trial State 
Assessment Program in which public-school students in 37 states, the District of 
Columbia, and two territories were assessed in eighth-grade mathematics. 1 The 1992 
NAEP program included an expanded Trial State Assessment Program in fourth-grade 
reading and fourth- and eighth-grade mathematics, with public-school students assessed 
in 41 states, the District of Columbia, and two territories. 2 

The continuation of NAEP’s Trial State Assessment Program in 1994 was 
authorized by additional legislation that enlarged the state-by-state assessment to include 
non-public school students. In addition to the state assessment program in reading at 
grade 4, the 1994 NAEP involved national assessments of reading, world geography, 
and U.S. history at grades 4, 8, and 12. The 1994 Trial State Assessment Program was 
conducted in February 1994 with 44 participants (41 states, the District of Columbia, 
Guam, and the Department of Defense Education Activity [DoDEA] Overseas Schools). 

This computer-generated report describes the reading proficiency of fourth-grade 
students in Louisiana, the Southeast region, and the nation. The distribution of reading 
proficiency results and reading achievement level results are provided for groups of 
students defined by shared characteristics: race/ethnicity, type of location, parents’ 
education level, and gender. Contextual information about reading policies, instruction, 
and home support for reading is presented for public school students. State results are 
based on the representative sample of students who participated in the 1994 Trial State 
Reading Assessment Program. Results for the region and the nation are based on the 
regional and national representative samples of students who participated in the national 
NAEP assessment. 

1 For a summary of the 1990 program, see Ina V.S. Mullis, John A. Dossey, Eugene H. Owen, and Gary W. Phillips. 
The State of Mathematics Achievement: NAEPs 1990 Assessment of the Nation and the Trial Assessment of the States. 
(Washington, DC: National Center for Education Statistics, 1991). 

2 

For a summary of the 1992 assessment of reading, see Ina V.S. Mullis, Jay R. Campbell, and Alan E. Farstrup. The 
NAEP 1992 Reading Report Card for the Nation and the States. (Washington, DC: National Center for Education 
Statistics, 1993). For a summary of the 1992 assessment of mathematics, see Ina V.S. Mullis, John A. Dossey, Eugene 
H. Owen, and Gary W. Phillips. NAEP 1992 Mathematics Report Card for the Nation and the States. (Washington, 
DC: National Center for Education Statistics, 1993). 
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School and Student Participation in the Reading Assessment 

In Louisiana, 103 public schools and 19 non-public schools participated in the 
1994 fourth-grade reading assessment. These numbers include participating substitute 
schools that were selected to replace some of the nonparticipating schools from the 
original sample. The weighted school participation rate after substitution in 1994 was 
100 percent for public schools and 91 percent for non-public schools, which means that 
the fourth-grade students in this sample were directly representative of 100 percent and 
91 percent of all the fourth-grade public and non-public school students in Louisiana, 
respectively. 

In Louisiana, 2,713 public school and 457 non-public school fourth-grade students 
were assessed in 1994. The weighted student participation rate was 96 percent for 
public schools and 97 percent for non-public schools. This means that the sample of 
fourth-grade students who took part in the assessment was directly representative of 
96 percent of the eligible public school student population and 97 percent of the 
eligible non-public school student population in participating schools in Louisiana (that 
is, all students from the population represented by the participating schools, minus those 
students excluded from the assessment). 

The overall weighted response rate (school rate times student rate) was 96 percent 
and 88 percent for public and non-public schools, respectively. This means that the 
sample of students who participated in the assessment was directly representative of 
96 percent of the eligible fourth-grade public school population and 88 percent of the 
eligible fourth-grade non-public school population in Louisiana. 

Following standard practice in survey research, the results presented in this report 
were produced using calculations which incorporate adjustments for the nonparticipating 
schools and students. Hence, the final results derived from the sample provide estimates 
of the reading proficiency and achievement for the full population of eligible public and 
non-public school fourth-grade students in Louisiana. However, these nonparticipation 
adjustments may not adequately compensate for the missing sample schools and students 
in instances where nonparticipation rates are large. 

In order to guard against potential nonparticipation bias in published results, NCES 
has established minimum participation levels necessary for the publication of 1994 Trial 
State Assessment results. NCES also established additional guidelines that address four 
ways in which nonparticipation bias could be introduced into a jurisdiction’s published 
results (see Appendix A). In 1994, Louisiana met all established NCES participation 
rate guidelines for both public and nonpublic schools. Hence, results for both types of 
schools are included in this report. 
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Students’ Reading Performance 

The table below shows the distribution of reading proficiency of fourth-grade 
students attending public schools in Louisiana, the Southeast region, and the nation. 

1994 , Public School Students 

The average reading proficiency of fourth-grade public school students 
in Louisiana on the NAEP reading scale was 197. This average was 
lower than that of students across the nation (212). 3 The lowest 
performing 10 percent of public school fourth graders in Louisiana had 
proficiencies at or below 146 while the top 10 percent had proficiencies 
at or above 246. In public schools across the nation, the lowest 
performing 10 percent of fourth graders had proficiencies at or below 
156; the top performing 10 percent of students had proficiencies at or 
above 261. 



1992 vs 1994 , Public School Students 
There was a decline in the average performance of fourth-grade public 
school students in Louisiana from 1992 to 1994 (204 in 1992 and 197 
in 1994). During the same period, there was no significant change in 
the average performance of fourth-grade public school students across 
the nation (215 in 1992 and 212 in 1994). 




1994 Tnal State Assessment 



1992 

Louisiana 

Southeast 

Nation 

1994 

Louisiana 

Southeast 

Nation 



Distribution of Reading Proficiency for Fourth-Grade 
Public School Students 



Average 

Proficiency 


10th 

Percentile 


25th 

Percentile 


50th 

Percentile 


75th 

Percentile 


90th 

Percentile 




204 (M2) • 

211 ('25) 
,215(1.0) ^ 


? 16l (2.5); 
; :163 


•181^22)., 
; ; 187: (3.5) 


: 204: (:1 2): :r 
l :213 £3.6) . I 

: ; ; 2i7;<|i:7).,;i ; 


227 (1.3) 

. 235 ( 2.7 
240 ( 1.3) •; 


245 (vl . 5) • 
• 254(4.1)^; 
: 259;(.2.3)i::;. 


197(1 i) ;«rV.S 
208 ( 2.0) 
212(1.1) 


146(2.8) <.. 
154(a4)i:-: 
156 ( 2.1)i.< ~ 


' ; :i7f-('i.9)i<;?> 
181. (3.0) 
187 (1.5) < 


198 ( 1.8) < 
211(2 A) 
217 ( 12) ; 


:224; ( i ;6)t^“ 
236(2.9) 
•241 (1.2) : 


246 ( 2.6)* r 
257 ( 1.9) 
261 (1.5) 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 




3 Differences reported as significant are statistically different at the 95 percent confidence level. This means that with 
95 percent confidence there is a real difference in the average reading proficiency between the two populations of 
interest. 
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Performance According to Purpose for Reading 

The 1994 Trial State Assessment Program considered students’ performance in 
situations that involved reading different kinds of materials for different purposes. The 
fourth-grade reading assessment measured two global purposes for reading — reading 
for literary experience and reading to gain information. The table below provides 
results for Louisiana, the Southeast region, and the nation according to each reading 
purpose. 



1994, Public School Students 

The proficiency of public school students in Louisiana in reading for 
literary experience (198) was lower than that of students across the 
nation (214). Similarly, in reading to gain information, the proficiency 
of public school students in Louisiana (195) was lower than that of 
students across the nation (210). 

1992 vs 1994, Public School Students 
Louisiana’s public school fourth graders showed a decline from 1992 to 
1994 in reading for literary experience. Similarly, in reading to gain 
information, public school fourth graders in Louisiana exhibited a 
decline from 1992 to 1994. 
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Distribution of Reading Proficiency for Fourth-Grade 
Public School Students According to Purpose for 
Reading 



1994 Trial State Assessment 


Average 

Proficiency 


10th 

Percentile 


25th 

Percentile 


50th 

Percentile 


75th 

Percentile 


90th 

Percentile 




Reading for Literary Experience 














1992 Public 










. _ • 




Louisiana 


207 ( \ .3) v. : ;fe 
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184(2.1) :i.. 


209 ( 1.9) < 


231 ( 1.0) i 


250 ( 0.8) 


Southeast 


212 ( 2.4):%.; 
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.2154:2.7 ) 'l 
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169 ( 


g194|T^)^| 


: 2194'Ll)|g 
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214.< 1J2) 


157 (-2^)::< :: 


: 1894 1-6);; 
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244 ( 1 2) 


264 ( 1.3) ^ 


Reading to Gain Information 








‘ ; ^ ’ 


;-g; ‘ - : v 




1992 Public 








z. 




, ' 


Louisiana 


'•199J('1.3)r:S 


; i53:(h.8)C. : ". 


li-1754 1.3)4 


200( 1.8)i : ; 


:224 ( T.7)-:6 


246 4:1.8) 
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2x&i{.zjym 


159 ( 3.5); 


;183 ( 3 4) 


r;:2i043^).ir 


234 ( 3.0) ti:, 


255 ( 316) 
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21241 , 2 );!: 


162 (1.8) 


:187{ 1.4) v 


2i4;(; : ; i^):p4: 


238 (13) J; : 


: 259 ( i:9) 
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■ 


'/ .. V 










Louisiana 


19544:5) < 


: ;143 ( 3.0): < 


l 16942.1) V 


' 195 ( 1.4) fe ; 


223 ( 1.9) 


246 (1.7) |i : 


Southeast 


20542.0) 


149(2.5). 


178 (2.6) 


207 ( 2.1) M 


234 ( 1.6) 


2574 2.0) 


Nation 


210(1.2) 


•151 i( 2.0) <•' 


183(1.4) 


214 ( 1,5) 


240 ( 1£) V 
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The NAEP “purpose for reading” scales range from 0 to 500. The standard errors of the statistics appear in parentheses. 
It can be said with about 95 percent confidence that, for each population of interest, the value for the entire population 
is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error 
of the difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school 
students in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 
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Levels of Reading Achievement 

The most recent reauthorization of the National Assessment Governing Board 
(NAGB) continues the Board’s responsibilities to set policy for NAEP and to “develop 
appropriate student achievement levels for each age and grade in subject areas tested” 
(Pub. L. 103-382). 

NAGB developed three achievement levels for each grade — Basic, Proficient, 
and Advanced. Performance at the Basic level denotes partial mastery of the knowledge 
and skills that are fundamental for proficient work at each grade level. The central level, 
called Proficient, represents solid academic performance at each grade level tested. 
Students reaching this level demonstrate competency over challenging subject matter and 
are well prepared for the next level of schooling. Performance at the Advanced level 
signifies superior performance at the grade tested. Definitions of the three levels of 
reading achievement are given below. Chapter 3 provides further elaboration of these 
levels and presents examples of types of questions that students at each of the three 
achievement levels can respond to effectively. 
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Description of Fourth-Grade Reading Achievement 
Levels 



Achievement 

Level 


Scale 

Cutpoint 


Description 


ADVANCED 


268 


Fourth-grade students performing at the Advanced level 
should be able to generalize about topics in the reading 
selection and demonstrate an awareness of how authors 
compose and use literary devices. When reading text 
appropriate to fourth grade, they should be able to judge 
texts critically and, in general, give thorough answers that 
indicate careful thought. 


PROFICIENT 


238 


Fourth-grade students performing at the Proficient level 
should be able to demonstrate an overall understanding 
of the text, providing inferential as well as literal 
information. When reading text appropriate to fourth grade, 
they should be able to extend the ideas in the text by 
making inferences, drawing conclusions, and making 
connections to their own experiences. The connection 
between the text and what the student infers should be 
clear. 


BASIC' : 


208 


Fourth-grade students performing at the Basic level should 
demonstrate an understanding of the overall meaning of 
what they read. When reading texts appropriate for fourth 
graders, they should be able to make relatively obvious 
connections between the text and their own experiences. 
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The table below provides the percentage of fourth-grade students at or above each 
achievement level, as well as the percentage of students below the Basic level. 

1994, Public School Students 

The percentage of public school students in Louisiana who were at or 
above the Proficient level (15 percent) was lower than that of students 
across the nation (28 percent). 

1992 vs 1994, Public School Students 
From 1992 to 1994, there was no significant change in the percentage 
of public school students in Louisiana who attained the Proficient level 
(15 percent in 1992 and 15 percent in 1994). Similarly, there was no 
significant change in the percentage of public school students across the 
nation who attained the Proficient level (27 percent in 1992 and 
28 percent in 1994). 
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The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). If the notation 
> (<) appears, it signifies that the value for public school students in 1994 was significantly higher (lower) than the value 
for 1992 at about the 95 percent confidence level. 



Subpopulation Performance 

Assessment results repeatedly show differences in performance for subpopulations 
of students. 4 The 1994 Trial State Assessment provides additional information about 
the performance of important subpopulations by reporting on the reading proficiencies 
of various subgroups of the public school student population defined by race/ethnicity, 
type of location, parents’ education level, and gender. These results are summarized in 
the table on page 8. 



15 

4 

Ina V.S. Mullis, John A. Dossey, Jay R. Campbell, Claudia A. Gentile, Christine O’Sullivan, and Andrew S. Latham. 
NAEP 1992 Trends in Academic Progress . (Washington, DC: National Center for Education Statistics, 1994). 
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Race/Ethnicity 

1994 , Public School Students . The average reading proficiency of White 
students in Louisiana public schools was higher than that of Black and 
Hispanic students. 

1992 vs 1994 , Public School Students . There was a decrease in the 
average reading proficiency of Black public school students in Louisiana 
from 1992 to 1994. There was no significant change in the average 
reading proficiency of White or Hispanic public school students in 
Louisiana from 1992 to 1994. 

Type of Location 

1994 , Public School Students . The average reading proficiency of 

Louisiana students attending public schools in central cities was lower 
than that of students in urban fringe/large towns but was not 
significantly different from that of students in rural areas/small towns. 

7992 vs 1994, Public School Students . From 1992 to 1994, there was a 
decrease in the average reading proficiency of students attending public 
schools in central cities in Louisiana. From 1992 to 1994, there was 
no significant change in the average reading proficiency of students 
attending public schools in urban fringe/large towns or rural areas/small 
towns in Louisiana. 



Parents’ Education Level 

1994 , Public School Students. Public school students in Louisiana 
reporting that at least one parent graduated from college demonstrated 
an average reading proficiency which was lower than that of students 
who reported that at least one parent had some education after high 
school, did not differ significantly from that of students who reported 
that at least one parent graduated from high school or they did not know 
their parents’ education level, and was higher than that of students who 
reported that neither parent graduated from high school. 

7992 vs 1994 , Public School Students. Public school students in 
Louisiana who reported that they did not know their parents’ education 
level had a lower average reading proficiency in 1994 than in 1992. 
The average proficiency of public school students in Louisiana who 
reported that at least one parent graduated from college, at least one 
parent had some education after high school, at least one parent 
graduated from high school, or neither parent graduated from high 
school did not change significantly between 1992 and 1994. 

Gender 

1994 , Public School Students . In public schools in Louisiana, girls 
exhibited an average reading proficiency which was higher than that of 
boys. 

7992 vs 1994 , Public School Students. In Louisiana public schools, the 
average reading proficiency for boys was lower in 1994 than in 1992. 
Similarly, the average proficiency for girls was lower in 1994 than in 
1992. 
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* School sample size is insufficient to permit reliable regional results for type of location. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. ! Interpret 
with caution — the nature of the sample does not allow accurate determination of the variability of this statistic. 
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Reading Performance of Non-Public School Students 

The 1994 Trial State Assessment marks the first time that non-public school 
students were assessed at the state level. Therefore, separate non-public school results 
can be reported for Louisiana. Also, results based on a combined sample of public and 
non-public school students can be presented. The following table shows the distribution 
of overall reading proficiency for the non-public school and combined populations. The 
corresponding public school student results can be found in the table on page 3. 

Non-Public School Students 

The average reading proficiency of fourth-grade students in non-public 
schools in Louisiana was 227 . This average was not significantly 
different from that of non-public school students across the nation (231). 

Public and Non-Public School Student Comparison 
The average reading proficiency of fourth-grade students in non-public 
schools in Louisiana was higher than the average for public school 
students (227 for non-public and 197 for public). For the nation, the 
average reading proficiency for non-public school students was higher 
than that of their public school counterparts (231 for non-public and 212 
for public). 

1994, Public and Non-Public School Students Combined 

The average reading proficiency of grade 4 students from Louisiana was 
202. This average was lower than that of students across the nation 
(214). The lowest performing 10 percent of fourth graders from 
Louisiana had proficiencies at or below 149 while the top 10 percent 
had proficiencies at or above 251. The lowest performing 10 percent 
of students across the nation had proficiencies at or below 159 while the 
top 10 percent had proficiencies at or above 263. 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). 
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A Context for Understanding Students* Reading Proficiency in Public Schools 

Information on the reading performance of students in Louisiana can be better 
understood and used for improving instruction and setting policy when supplemented 
with contextual information about schools, teachers, and students. 

To gather contextual information, the fourth-grade students participating in the 
1994 Trial State Assessment, their reading teachers, and the principals or other 
administrators in their schools were asked to complete questionnaires on policies, 
instruction, and programs. The student, teacher, and school data help to describe some 
of the current practices and emphases in reading education, illuminate some of the 
factors that appear to be related to fourth-grade public-school students’ reading 
proficiency, and provide an educational context for understanding information on student 
achievement. Highlights of the results for the public-school students in Louisiana are 
as follows: 

CURRICULUM COVERAGE AND INSTRUCTIONAL EMPHASIS 

• In Louisiana in 1994, average reading proficiency was higher for 
students whose teachers spent 60 minutes on reading instruction than for 
students whose teachers spent 45 minutes or less on reading instruction 
each day. 

• According to the public school administrators in Louisiana, in 1994, 

92 percent of the fourth-grade students were in schools where reading 
was identified as receiving special emphasis. This percentage was not 
significantly different from* that of students across the country 
(85 percent). 

• In 1994, according to their reading teachers, 19 percent of the students 
in public schools in Louisiana were typically taught reading in a class 
that was grouped by reading ability. The prevalence of ability grouping 
was not significantly different across the nation (22 percent). 



DELIVERY OF READING INSTRUCTION 

• Students in Louisiana whose teachers used both basal and trade books 
demonstrated an average reading proficiency (195) which did not differ 
significantly from that of students whose teachers primarily used basal 
readers (199). 



* Although the difference may appear large, recall that “significance” here refers to “statistical significance.” (See 
Appendix A for further discussion.) 
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• In Louisiana, 23 percent of the fourth-grade students had reading 
teachers who used children’s newspapers and/or magazines at least once 
a week; 34 percent of the students had reading teachers who used 
reading kits at least once a week; 33 percent had reading teachers who 
used computer software for reading instruction at least once a week; 
50 percent of the students had reading teachers who used a variety of 
books at least once a week; and, finally, 54 percent of the students had 
reading teachers who used materials from other subject areas at least 
once a week. 

• According to the Louisiana reading teachers, 61 percent of the students 
were asked to discuss new or difficult vocabulary almost every day. 
This percentage did not differ significantly from that of students across 
the nation (62 percent). 

• According to their reading teachers, the percentage of students in 
Louisiana who were asked to talk with each other almost every day 
about what they have read (23 percent) was smaller than that of students 
across the nation, where 34 percent of the students were asked to do this 
activity almost every day. 

• According to the reading teachers in Louisiana, 3 percent of the students 
were asked to do a group activity or project about what they have read 
almost every day. This figure was not significantly different from that 
of students across the nation (5 percent). 



EDUCATIONAL BACKGROUND OF TEACHERS 

• The percentage of students who were being taught by reading teachers 
who reported having at least a master’s or education specialist’s degree 
in Louisiana (30 percent) was smaller than that for the nation 
(41 percent). 

• More than half of the students (64 percent) had reading teachers who 
had the highest level of teaching certification that is recognized by 
Louisiana. This did not differ significantly from the figure for the 
nation, where 65 percent of the students were taught by reading teachers 
who were certified at the highest level available in their states. 

• In Louisiana, 9 percent of the students were being taught reading by 
teachers who had an undergraduate major in English, reading, and/or 
language arts. This was smaller than the percentage of students across 
the nation who were being taught by reading teachers with the same 
major (20 percent). 
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HOME FACTORS 

• In Louisiana, 24 percent of the students reported having four types of 
reading materials (a newspaper, an encyclopedia, 25 or more books, and 
magazines) in the home. This figure was lower than that for the nation 
(36 percent). Students in Louisiana who had all four of these types of 
materials in the home showed an average reading proficiency (207) 
which was higher than that of students with zero to two types of 
materials (188). 

• In 1994 in Louisiana, 33 percent of the students discussed with friends 



or family what they read almost every day. This percentage was greater 
than that of students across the nation (28 percent). The proficiency 
of students in Louisiana who discussed what they read with friends or 
family almost every day (194) did not differ significantly from that of 
students who had discussions with friends or family less than weekly 



• Less than one third of the fourth-grade students (28 percent) watched 
six hours or more of television each day. This was larger than the figure 
for the nation, where 22 percent of the students watched this much 
television. Average reading proficiency in Louisiana was lowest for 
students who spent six hours or more watching television each day. 

Comparisons of Overall Reading Proficiency in Louisiana with Other States 
The map on the following page provides a method for making appropriate 
comparisons of the overall public school reading proficiency in Louisiana with that in 
other states (including Guam and the Department of Defense Education Activity 
[DoDEA] Overseas Schools) that participated in the NAEP 1994 Trial State Assessment 
Program. The different shadings of the states on the map show whether the average 
overall proficiency of public school students in the other states was statistically different 
from or not statistically different from that of public school students in Louisiana 
(“Target State”). States in black have a significantly lower average public school 
proficiency than does Louisiana. States with a dark-gray shading have a significantly 
higher average public school proficiency than does Louisiana. States with a light-gray 
shading have an average public school proficiency that does not differ significantly from 
that of Louisiana. The significance tests are based on a Bonferroni procedure for 
multiple comparisons that holds the probability of erroneously declaring the means of 
any two states to be different, when they are not, to no more than five percent. Two 
states — Idaho and Michigan — did not meet minimum school participation guidelines 
for public schools. Another jurisdiction — Washington, DC — withdrew from the Trial 
State Assessment after the data collection phase. Therefore, these three jurisdictions are 
not included in the comparisons depicted on the map on the following page. 



(196). 
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OVERVIEW 



or over 25 years, the National Assessment of Educational Progress (NAEP) 
has been the nation’s primary indicator of student achievement, reporting on what 
students know and can do in various school subject areas at grades 4, 8, and 12. With 
legislation passed by Congress in 1988, NAEP’s mission of providing dependable and 
comprehensive information about educational progress in the United States was 
expanded to involve a voluntary state-by-state assessment on a trial basis. 

Consequently, the 1990 NAEP program included a Trial State Assessment 
Program in which public school students in 37 states, the District of Columbia, and two 
territories were assessed in eighth-grade mathematics. 5 Building on this initial effort, 
the 1992 NAEP program included a Trial State Assessment Program in fourth-grade 
reading and fourth- and eighth-grade mathematics, with public school students assessed 
in 41 states, the District of Columbia, and two territories. 6 

The continuation of NAEP’s Trial State Assessment Program in 1994 was 
authorized by additional legislation that enlarged the state-by-state assessment to include 
non-public school students: 

The National Assessment shall conduct in 1994 ... a trial reading 
assessment for the 4th grade, in states that wish to participate , with the 
purpose of determining whether such assessments yield valid and 
reliable State representative data. ( Section 406(i)(2)(C)(i) of the 

General Education Provisions Act, as amended by Pub. L. 103-33 
(U.S.C. 1221e-l(a)(2)(B)(iii))) 

The National Assessment shall include in each sample assessment . . . 
students in public and private schools in a manner that ensures 
comparability with the national sample. ( Section 406(i)(2)(C)(i) of the 
General Education Provisions Act, as amended by Pub. L. 103-33 
(U.S.C. 1221e-l(a)(2)(B)(iii))) 



5 For a summary of the 1990 program, see Ina V.S. Mullis, John A. Dossey, Eugene H. Owen, and Gary W. Phillips. 
The State of Mathematics Achievement: NAEP’s 1990 Assessment of the Nation and the Trial Assessment of the States. 
(Washington, DC: National Center for Education Statistics, 1991). 

6 For a summary of the 1992 assessment of reading, see Ina V.S. Mullis, Jay R. Campbell, and Alan E. Farstrup. The 
NAEP 1992 Reading Report Card for the Nation and the States. (Washington, DC: National Center for Education 
Statistics, 1993). For a summary of the 1992 assessment of mathematics, see Ina V.S. Mullis, John A. Dossey, Eugene 
H. Owen, and Gary W. Phillips. NAEP 1992 Mathematics Report Card for the Nation and the States. (Washington, 
DC: National Center for Education Statistics, 1993). 
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In addition to the state assessment program in reading at grade 4, the 1994 NAEP 
involved national assessments of reading, geography, and history at grades 4, 8, and 12. 

The 1994 Trial State Assessment Program was conducted in February 1994 with 
the following 44 participants: 
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Jurisdictions in italics — Montana, Washington, and the Department of Defense 
Education Activity (DoDEA) Overseas Schools — did not participate in the 1992 Trial 
State Assessment Program. Two states — Idaho and Michigan — did not meet minimum 
school participation guidelines for public schools. Another jurisdiction — Washington, 
DC — withdrew from the Trial State Assessment Program after the data collection 
phase. Therefore, public school results for these three jurisdictions are not reported. 
Three jurisdictions — Ohio, Oklahoma, and the Virgin Islands — participated in the 
1992 Trial State Assessment but not in the 1994 program. 

For the 1994 Trial State Assessment in reading, a combined sample of 
approximately 2,800 public and non-public school students was assessed in most 
jurisdictions. The samples were carefully designed to represent the fourth-grade 
populations in the states or jurisdictions. Participating jurisdictions were responsible for 
the administration of the assessment. For jurisdictions that participated in the 1992 Trial 
State Assessment Program, contractor staff monitored 25 percent of public school 
sessions and 50 percent of non-public school sessions. For jurisdictions that did not 
participate in 1992, contractor staff monitored 50 percent of both public and non-public 
school sessions. Monitoring efforts were part of a quality assurance program designed 
to ensure that sessions were conducted uniformly. 

The 1992 Trial State and National Assessment programs in reading were based 
on a framework developed through a national consensus process that was set forth by 
law and called for “active participation of teachers, curriculum specialists, subject matter 
specialists, local school administrators, parents, and members of the general public” 
(Pub. L. 100-297, Part C, 1988). 7 This same framework served as the basis of the 1994 
Trial State and National Assessment programs. 



NAEP Reading Consensus Project. Reading Framework for the 1992 and 1994 National Assessment of Educational 
Progress. (Washington, DC: National Assessment Governing Board, U.S. Department of Education, 1994). 
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The process of developing the framework was carried out in late 1989 and early 
1990 by the Council of Chief State School Officers (CCSSO) under contract from the 
National Assessment Governing Board (NAGB) which is responsible for formulating 
policy for NAEP, including developing assessment objectives and test specifications. 
The framework development process included gathering input from a wide range of 
people in the fields of reading and assessment, such as school teachers, administrators, 
and state coordinators of reading and reading assessment. After thorough discussion and 
some amendment, the framework was adopted by NAGB in March 1990. An overview 
of the reading framework is provided in Appendix A. 

The 1994 fourth-grade Trial State and National Assessments in reading consisted 
of eight sections or blocks, each 25 minutes in length. All fourth-grade students in the 
assessment were required to complete two blocks. Each block contained a passage or 
set of passages and a combination of constructed-response and multiple-choice 
questions. Passages selected for the assessment were drawn from authentic texts used 
by students in typical reading situations. Complete stories, articles, or sections of 
textbooks were used, rather than excerpts or abridgements. The type of question — 
constructed-response or multiple-choice — was determined by the objective being 
measured. In addition, the constructed-response questions were of two types: short 
constructed-response questions which required students to respond to a question in a few 
words or a few sentences and extended constructed-response questions which required 
students to respond to a question in a paragraph or more. 



This Report 

This is a computer-generated report that describes the reading performance of 
fourth-grade students in Louisiana, in the Southeast region, and across the nation. A 
separate report describes additional fourth-grade reading assessment results for the nation 
and the states, as well as the national results for grades 8 and 12. 8 This report consists 
of four sections: 

• This Overview provides background information about the 1994 Trial 
State Assessment Program and a profile of the fourth-grade students in 
Louisiana. 

• Part One shows the distribution of reading proficiency results for 
fourth-grade students in Louisiana, the Southeast region, and the nation. 

• Part Two presents reading achievement level results for fourth graders 
in Louisiana, the Southeast region, and the nation. 

• Part Three relates fourth-grade public school students’ reading 
proficiency to contextual information about the reading policies, 
instruction, and home support for reading in Louisiana, the Southeast 
region, and the nation. 



8 See NAEP 1994 Reading Report Card for the Nation and the States. 
Statistics, 1995). 
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In this report, results are provided for groups of students defined by shared 
characteristics — race/ethnicity, type of location, parents’ education level, and gender. 
Based on criteria described in Appendix A, data are reported for subpopulations only 
where sufficient numbers of students and adequate school representation are present. 

For public school students, there must be at least 62 students in a particular subgroup 
from at least 10 different schools. For non-public school students, the minimum 
requirement is 62 students representing at least 6 different schools. However, the data 
for all students, regardless of whether their subgroup was reported separately, were 
included in computing overall results for Louisiana. Definitions of the subpopulations 
referred to in this report are presented below. 

The results for Louisiana are based on the representative sample of students who 
participated in the 1994 Trial State Assessment Program. The results for the nation and 
the region of the country are based on the nationally and regionally representative 
samples of students who were assessed in January through March as part of the national 
NAEP program. Using the national and regional results from the 1994 national NAEP 
program is necessary because of the voluntary nature of the Trial State Assessment 
Program. Since not every state participated in the program, the aggregated data across 
states did not necessarily provide representative national or regional results. Specific 
details on the samples and analysis procedures used can be found in the Technical Report 
of the 1994 NAEP Trial State Assessment Program in Reading? 

Race/Ethnicity 

Results are presented for students of different racial/ethnic groups based on the 
students’ self-identification of their race/ethnicity according to the following mutually 
exclusive categories: White, Black, Hispanic, Asian, Pacific Islander, and American 
Indian (including Alaskan Native). In 1992, the question posed to students regarding 
their racial/ethnic background had one Asian/Pacific Islander category. In 1994, these 
were two distinct response options for the question. Consequently, data and trend results 
for the separate categories are not available for the 1992 sample. 

Type of Location 

Results are provided for students attending public schools in three mutually 
exclusive location types — central city, urban fringe/large town, and rural/small town 
— as defined below. The type of location variable is defined in such a way as to indicate 
the geographical location of a student’s school. The intention is not to indicate, or 
imply, social or economic meanings for these location types. The type of location 
variable, given the current NAEP sampling, does not support the reporting of regional 
results. Therefore, only state and national results will be presented. 



Central City: The Central City category includes central cities of all 
Standard Metropolitan Statistical Areas (SMSA’s). 10 Central City is a 
geographic term and is not synonymous with “inner city.” 



9 Technical Report of the NAEP 1994 Trial State Assessment Program in Reading. (Washington, DC: National Center 
for Education Statistics, 1995). 

10 Standard Metropolitan Statistical Area (SMS A) as defined by the Office of Management and Budget 
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Urban Fringe/Large Town: An Urban Fringe includes all densely 

settled places and areas within SMSA’s that are classified as urban by 
the Bureau of the Census. A Large Town is defined as places outside 
SMSA’s with a population greater than or equal to 25,000. 

Rural/Small Town: Rural includes all places and areas with a 

population of less than 2,500 that are classified as rural by the Bureau 
of the Census. A Small Town is defined as places outside SMSA’s 
with a population of less than 25,000 but greater than or equal to 2,500. 

Parents’ Education Level 

Students were asked to indicate the extent of schooling for each of their parents 
— did not finish high school, graduated from high school, had some education after high 
school, graduated from college, or did not know. The response indicating the higher 
level of education was selected for reporting. Note that a substantial percentage of 
fourth-grade students did not know their parents’ education level. 

Gender 

Results are reported separately for males and females. 

Region 

The United States has been divided into four regions for purposes of this report: 
Northeast, Southeast, Central, and West. States included in each region are shown in 
Figure O.l. All 50 states and the District of Columbia are listed, with the participants 
in the 1994 Trial State Assessment Program highlighted in boldface type. Guam and 
the Department of Defense Education Activity (DoDEA) Overseas Schools were not 
assigned to a region. Further, students attending schools in the part of Virginia that is 
included in the Washington, DC, metropolitan statistical area are included in the 
Northeast regional results; students attending schools in the remainder of the state are 
included in the Southeast regional results. Because most of the Virginia students are in 
the Southeast region, regional comparisons for Virginia are to the Southeast. 

Regional results are based on national assessment samples, not on aggregated Trial 
State Assessment samples, as explained on the previous page. Thus, the regional results 
are based on a different and separate sample from that used to report the state results. 
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FIGURE 0.1 
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Note: Part of Virginia (near metropolitan Washington, DC) is included in the Northeast region, and the rest of Virginia 
is in the Southeast region. 



Non-Public Schools 

Samples for the 1994 Trial State Assessment Program were expanded to include 
students attending non-public schools (Catholic schools and other religious and private 
schools) in addition to the public school students. The expanded coverage was instituted 
for the first time in 1994. Samples for the 1990 and 1992 Trial State Assessment 
Programs had been restricted to public school students only. For those jurisdictions 
meeting pre-established participation rate standards (see Appendix A), separate results 
are reported for non-public schools and for the combined public and non-public school 
samples. The combined sample also contains students attending Bureau of Indian 
Affairs (BIA) schools and domestic Department of Defense schools. These two 
categories of schools are not included in either the public or non-public school samples. 
The DoDEA Overseas Schools are considered public schools and are reported as a 
separate jurisdiction for the first time in 1994. 
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Guidelines for Analysis and Reporting 



This report describes reading performance for fourth graders and compares the 
results for various groups of students within that population — for example, those who 
have certain demographic characteristics or who responded to a specific background 
question in a particular way. The report examines the results for individual demographic 
groups and individual background questions. It does not include an analysis of the 
relationships among combinations of these subpopulations or background questions. 

Because the percentages of students in these subpopulations and their average 
proficiencies are based on samples — rather than on the entire population of fourth 
graders in a jurisdiction — the numbers reported are necessarily estimates. As such, they 
are subject to a measure of uncertainty, reflected in the standard error of the estimate. 
When the percentages or average proficiencies of certain groups are compared, it is 
essential to take the standard error into account, rather than to rely solely on observed 
similarities or differences. Therefore, the comparisons discussed in this report are based 
on statistical tests that consider both the magnitude of the difference between the means 
or percentages and the standard errors of those statistics. 

The statistical tests determine whether the evidence — based on the data from the 
groups in the sample — is strong enough to conclude that the means or percentages are 
really different for those groups in the population. If the evidence is strong (i.e., the 
difference is statistically significant), the report describes the group means or 
percentages as being different (e.g., one group performed higher than or lower than 
another group) — regardless of whether the sample means or sample percentages appear 
to be about the same or not. If the evidence is not sufficiently strong (i.e., the difference 
is not statistically significant), the means or percentages are described as being not 
significantly different — again, regardless of whether the sample means or sample 
percentages appear to be about the same or widely discrepant. The reader is cautioned 
to rely on the results of the statistical tests — rather than on the apparent magnitude of 
the difference between sample means or percentages — to determine whether those 
sample differences are likely to represent actual differences between the groups in the 
population. The statistical tests and Bonferroni procedure, which is used when more 
than two groups are being compared, are discussed in greater detail in Appendix A. 

In addition, some of the percentages reported in the text of the report are given 
quantitative descriptions (e.g., relatively few, about half, almost all, etc.). The 
descriptive phrases used and the rules used to select them are also described in 
Appendix A. 
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Finally, in several places in this report, results (mean proficiencies and 
percentages) are reported in the text for combined groups of students. For example, in 
the text, the proficiency of students in the combined group who reported reading for fun 
once or twice a month or never or hardly ever is given and compared to the group who 
reported reading for fun almost every day. However, the table that accompanies that text 
reports percentages and proficiencies separately for the four groups (almost every day, 
once or twice a week, once or twice a month, and never or hardly ever). The combined 
group proficiencies reported in the text and used in all statistical tests are based on 
unrounded estimates (i.e., estimates calculated to several decimal places) of the 
proficiencies for each group. The percentages shown in the tables are rounded to 
integers. Thus, percentages may not always add up to 100 percent due to rounding. 
Also, the percentage for a combined group (reported in the text) may differ slightly from 
the sum of the separate percentages (presented in the tables) for each of the groups that 
were combined. Therefore, if statistical tests were to be conducted based on the rounded 
numbers in the tables, the results might not be consonant with the results of the statistical 
tests that are reported in the text (based on unrounded numbers). 

Profile of Louisiana 

Fourth-Grade School and Student Characteristics 

Table 0.1 provides a profile of the demographic characteristics of the fourth-grade 
students in Louisiana, the Southeast region, and the nation. This profile is based on data 
collected from the students and schools participating in the 1992 and 1994 Trial State 
and National Assessments. As described earlier, the state data and the regional and 
national data are drawn from separate samples. 

Schools and Students Assessed 

Table 0.2 summarizes participation data for schools and students sampled in 
Louisiana for both the 1992 and 1994 Trial State Assessments. 11 In Louisiana, 103 
public schools and 19 non-public schools participated in the 1994 fourth-grade reading 
assessment. These numbers include participating substitute schools that were selected 
to replace some of the nonparticipating schools from the original sample. The weighted 
school participation rate after substitution in 1994 was 100 percent for public schools 
and 91 percent for non-public schools, which means that the fourth-grade students in 
this sample were directly representative of 100 percent and 91 percent of all the 
fourth-grade public and non-public school students in Louisiana, respectively. 



For a detailed discussion of the NCES guidelines for sample participation, see School and Student Participation Rates 
for the Reading Assessment and Guidelines for Participation . (Washington, DC: National Center for Education 
Statistics, 1994); or see Appendix B of the Technical Report of the NAEP 1994 Trial State Assessment Program in 
Reading. (Washington, DC: National Center for Education Statistics, 1995). 
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In each school, a random sample of students was selected to participate in the 
assessment. In 1994, as estimated by the sample, 1 percent of the fourth-grade public 
school population and 0 percent of the non-public school population were classified as 
Limited English Proficient (LEP), while 1 1 percent in public schools and 1 percent in 
non-public schools had an Individualized Education Plan (IEP). An IEP is a plan, 
written for a student who has been determined to be eligible for special education, that 
typically sets forth goals and objectives for the student and describes a program of 
activities and/or related services necessary to achieve the goals and objectives. Students 
with disabilities may be categorized as IEP. 

Schools were permitted to exclude certain students from the assessment, provided 
that certain criteria were met. To be excluded, a student had to be categorized as 
Limited English Proficient or had to have an Individualized Education Plan and (in 
either case) be judged incapable of participating in the assessment. The intent was to 
assess all selected students; therefore, all selected students who were capable of 
participating in the assessment should have been assessed. However, schools were 
allowed to exclude those students who, in the judgment of school staff, could not 
meaningfully participate. The NAEP guidelines for exclusion are intended to assure 
uniformity of exclusion criteria from school to school. Note that some LEP and IEP 
students were deemed eligible to participate and not excluded from the assessment. The 
students in Louisiana who were excluded from the assessment because they were 
categorized as LEP or had an IEP represented 6 percent of the public school population 
and 0 percent of the non-public school population in grade 4. 

In Louisiana, 2,713 public school and 457 non-public school fourth-grade students 
were assessed in 1994. The weighted student participation rate was 96 percent for 
public schools and 97 percent for non-public schools. This means that the sample of 
fourth-grade students who took part in the assessment was directly representative of 
96 percent of the eligible public school student population and 97 percent of the 
eligible non-public school student population in participating schools in Louisiana (that 
is, all students from the population represented by the participating schools, minus those 
students excluded from the assessment). 

The overall weighted response rate (school rate times student rate) was 96 percent 
and 88 percent for public and non-public schools, respectively. This means that the 
sample of students who participated in the assessment was directly representative of 
96 percent of the eligible fourth-grade public school population and 88 percent of the 
eligible fourth-grade non-public school population in Louisiana. 
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TABLE 0.1 

Profile of Fourth-Grade Students in Louisiana, the 
Southeast Region, and the Nation 
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— Separate statistics for Asian and Pacific Islander students were not available in 1992. * School sample size is 

insufficient to permit reliable regional results for type of location. The standard errors of the statistics appear in 
parentheses. It can be said with about 95 percent confidence that, for each population of interest, the value for the entire 
population is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the 
standard error of the difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for 
public school students in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence 
level. The percentages for Race/Ethnicity may not add to 100 percent because some students categorized themselves as 
“Other.” 
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Following standard practice in survey research, the results presented in this report 
were produced using calculations which incorporate adjustments for the nonparticipating 
schools and students. Hence, the final results derived from the sample provide estimates 
of the reading proficiency and achievement for the full population of eligible public and 
non-public school fourth-grade students in Louisiana. However, these nonparticipation 
adjustments may not adequately compensate for the missing sample schools and students 
in instances where nonparticipation rates are large. 

In order to guard against potential nonparticipation bias in published results, NCES 
has established minimum participation levels necessary for the publication of 1994 Trial 
State Assessment results. NCES also established additional guidelines that address four 
ways in which nonparticipation bias could be introduced into a jurisdiction’s published 
results (see Appendix A). In 1994, Louisiana met all established NCES participation 
rate guidelines for both public and nonpublic schools. Hence, results for both types of 
schools are included in this report. 

In the analysis of student data and reporting of results, nonresponse weighting 
adjustments have been made at both the school and student level, with the aim of making 
the sample of participating students as representative as possible of the entire eligible 
fourth-grade population. For details of the nonresponse weighting adjustment 
procedures, see the Technical Report of the NAEP 1994 Trial State Assessment Program 
in Reading. 
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TABLE 0.2 

Profile of the Fourth-Grade Population Assessed in 
Louisiana 
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The nonparticipating non-public schools in Louisiana in 1994 included a class of schools with similar characteristics, 
which together accounted for more than five percent of Louisiana’s total fourth-grade weighted sample of non-public 
schools. The classes of schools from each of which a jurisdiction needed minimum school participation levels were 
determined by type of non-public school (Catholic versus non-Catholic) and location (metropolitan versus 
non-metropolitan). 
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PART ONE 



The Reading Proficiency of Fourth-Grade 
Students in Louisiana 

I^eading involves the interaction between and among a reader, a text, and a 
situation. 12 Thus, students’ reading comprehension is influenced by the type of material 
read and the specific purposes for reading. The 1994 Trial State Assessment Program 
considered students’ proficiency in situations that involved reading different kinds of 
materials for different purposes. The fourth-grade reading assessment measured two 
global purposes for reading — reading for literary experience and reading to gain 
information . 13 Students’ proficiency on each of the two purposes for reading was 
summarized on separate NAEP reading scales (one for each purpose), which range from 
0 to 500. In addition, results for an overall reading scale reflecting average proficiency 
across the two purposes for reading are also presented. The overall reading scale also 
ranges from 0 to 500. 

This part of the report contains two chapters that describe the reading proficiency 
of fourth-grade students in Louisiana. Chapter 1 compares the overall reading 
proficiency of public school students in Louisiana to the Southeast region and the nation. 
It also presents the students’ average proficiency for the two purposes for reading. 
Chapter 2 summarizes reading proficiency for subpopulations of public school students 
defined by race/ethnicity, type of location, parents’ education level, and gender. The 
second chapter also provides the combined results for public and non-public school 
students, as well as the results for only non-public school students. 14 



12 J.A. Dole, G.G. Duffy, L.R. Roehler, and P.D. Pearson. “Moving from the Old to the New: Research on Reading 
Comprehension Instruction,” in Review of Educational Research, 61. (1991). pp. 239-264. 



13 The eighth- and twelfth-grade national NAEP reading assessments also measured a third purpose for reading — reading 
to perform a task. 



Due to the relatively small sample size for the non-public school students, results are not reported by subpopulation. 
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CHAPTER 1 



Students’ Reading Proficiency 

In 1994, renewed emphasis was placed on national education goals when Congress 
reauthorized the Elementary and Secondary Education Act ( ESEA ) and enacted the Goals 
2000: Educate America Act. A concern for higher academic standards is evident in the 
ESEA' s efforts to provide programs to improve America’s schools. Goals 2000 reasserts 
the importance of establishing and meeting rigorous goals in the education of our 
nation’s students — All students will leave grades 4, 8, and 12 having demonstrated 
competency over challenging subject matter including English , mathematics , science , 
foreign languages , civics and government , economics , arts , history , and geography , and 
every school in America will ensure that all students learn to use their minds well , so they 
may be prepared for responsible citizenship, further learning , and productive employment 
in our nation ’ s modem economy. Reading ability can be viewed as an enabling skill for 
reaching these goals. Therefore, concern about attaining these goals and, more 
specifically, about the reading abilities of our nation’s students has increased because 
recent NAEP results appear to indicate that many students of all ages have difficulty 
reading thoughtfully. 15 

The NAEP Reading Framework underlying both the 1992 and 1994 assessments 
views reading as a dynamic, complex interaction between and among the reader, the text, 
and the context of the reading experience. Readers, for example, bring to the reading 
process their prior knowledge about a topic, their reasons for reading, their individual 
reading skills and strategies, and their understanding of differences in text structures. 16 

The texts used in the NAEP reading assessment are representative of common 
reading demands. Because reading performance varies in response to texts and contexts, 
the NAEP assessment measured students’ abilities to read different types of materials 
for different purposes. The texts were selected from naturally-occurring sources that are 
typically available to children in and out of school. Students in grade 4 were asked to 
respond to literary and informational texts, corresponding with the two purposes for 
reading assessed at grade 4 — reading for literary experience and reading to gain 
information. 




15 Ina V.S. Mullis, Jay R. Campbell, and Alan E. Farstrup. The NAEP 1992 Reading Report Card for the Nation and the 
States. (Washington, DC: National Center for Education Statistics, 1993); Ina V.S. Mullis, John A. Dossey, Jay R. 
Campbell, Claudia A. Gentile, Christine O’Sullivan, and Andrew S. Latham. NAEP 1992 Trends in Academic 
Progress. (Washington, DC: National Center for Education Statistics, 1994). 



16 



J.A. Langer. “The Process of Understanding: Reading for Literary and Informational Purposes,” in Research in the 
Teaching of English, 24. (1990). pp. 229-260; NAEP Reading Consensus Project- Reading Framework for the 1992 
and 1994 National Assessment of Educational Progress. (Washington, DC: National Assessment Governing Board, 
U.S. Department of Education, 1994). 
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Reading for literary experience typically involves the reader in vicarious 
experiences through the story’s characters or considerations of how the author explores 
human events. Literary texts include short stories, poems, and folktales that engage the 
reader in a variety of ways, not the least of which is reading for fun. Reading to gain 
information may involve seeking to learn about a topic or to search for specific 
information. Informational texts include selections from textbooks, magazines, 
encyclopedias, and other written sources whose purpose is to increase the reader’s 
knowledge. Differences between narrative and informational text typically require 
students to use different skills and strategies. 

In addition to having fourth graders demonstrate their ability to read for two 
different purposes, the assessment asked students to build, extend, and examine meaning 
from four stances or types of interactions with the text. 

Initial Understanding 

Students are asked to provide the overall or general meaning of the 
selection. This includes first impressions, main points, or themes. 

Developing an Interpretation 

Students are asked to extend the ideas in the text by making inferences 
and connections. This includes making connections between cause and 
effect, analyzing the motives of characters, and drawing conclusions. 

Personal Response 

Students are asked to make explicit connections between the ideas in the 
text and their own background knowledge and experiences. This 
includes comparing story characters with themselves or people they 
know, or indicating whether they found a passage useful or interesting. 

Critical Stance 

Students are asked to consider the text objectively. This includes 
identifying how the author crafted a text with stylistic devices such as 
mood and tone. 

These stances are not considered hierarchical or completely independent of each 
other. Rather, they are viewed as recursive processes that take place throughout reading 
and represent different dimensions of the reader’s understanding. They provide a frame 
for generating assessment questions and considering student performance at all levels. 
All students at all levels should be able to respond to reading selections from all of these 
stances. What varies with students’ developmental and proficiency levels is the amount 
of prompting or support needed to elicit their responses, the complexity of the texts to 
which they can respond, and the sophistication of their answers. 

This chapter describes the reading proficiency of Louisiana’s public school fourth 
graders in 1994 and the comparative results of their regional and national counterparts. 
In addition, this chapter provides a comparison of reading performance in 1992 and 1994 
for Louisiana’s fourth graders attending public schools. 
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Table 1.1 shows the distribution of reading proficiency of fourth-grade students 
attending public schools in Louisiana, the Southeast region, and the nation. 

1994 , Public School Students 

The average reading proficiency of fourth-grade public school students 
in Louisiana on the NAEP reading scale was 197. This average was 
lower than that of students across the nation (21 2). 17 The lowest 
performing 10 percent of public school fourth graders in Louisiana had 
proficiencies at or below 146 while the top 10 percent had proficiencies 
at or above 246. In public schools across the nation, the lowest 
performing 10 percent of fourth graders had proficiencies at or below 
156; the top performing 10 percent of students had proficiencies at or 
above 261. 



1992 vs 1994, Public School Students 
There was a decline in the average proficiency of fourth-grade public 
school students in Louisiana from 1992 to 1994 (204 in 1992 and 197 
in 1994). During the same period, there was no significant change in 
the average proficiency of fourth-grade public school students across the 
nation (215 in 1992 and 212 in 1994). 
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TABLE 1 .1 

Distribution of Reading Proficiency for Fourth-Grade 
Public School Students 



1994 Trial State Assessment 


Average 

Proficiency 


10th 

Percentile 


25th 

Percentile 


50th 

Percentile 


75th 

Percentile 


90th 

Percentile 


1992 

Louisiana 

Southeast 

Nation 

1994 

Louisiana 

Southeast 

Nation 


204(42)*/ 161 (£5) X 181(22) 204(12)::H' 227(1.3) 245 (IS) 

211( 2.5) 163 ( 3S) 187 ( 3.5)1?; 213(3.6) ix 235 ( 2.7) 254 ( 4.1) 

215(1.0)1 .168(1.9) 192 (1.0) 217 (4.7) ':|H 240 ( 13) 259 ( 2.3) 

197 ( 1.3) < 146 ( 2.8) ,« 171 (1.9) < 198 ( 1.8) < 224 (1.6) 246 ( 2.6) : 

208 ( 2.0)::* 154 ( 3.4) ; 181 < 3-0) ' , 211 (25) M 236 ( 29) 257(1.9) X 

212(1.1) 156 ( 2.1) « 187 :( 1.5) < 217 (12) 241 ( 12) 261 (1.5) 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 
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Differences reported as significant are statistically different at the 95 percent confidence level. This means that with 
95 percent confidence there is a real difference in the average reading proficiency between the two populations of 
interest 
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Proficiency According to Purpose for Reading 

As previously indicated, the questions in the 1994 Trial State Assessment Program 
covered two purposes for reading at grade 4 — reading for literary experience and 
reading to gain information. Table 1.2 provides results for Louisiana, the Southeast 
region, and the nation according to each reading purpose. 

1994, Public School Students 

The proficiency of public school students in Louisiana in reading for 
literary experience (198) was lower than that of students across the 
nation (214). Similarly, in reading to gain information, the proficiency 
of public school students in Louisiana (195) was lower than that of 
students across the nation (210). 

1992 vs 1994 , Public School Students 
Louisiana’s public school fourth graders showed a decline from 1992 to 
1994 in reading for literary experience. Similarly, in reading to gain 
information, they exhibited a decline from 1992 to 1994. 
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TABLE 1.2 

Distribution of Reading Proficiency for Fourth-Grade 
Public School Students According to Purpose for 
Reading 





Average 

Proficiency 


10th 

Percentile 


25th 

Percentile 


50th 

Percentile 


75th 

Percentile 


90th 

Percentile 






v '• 








V.X-. '.Ms*. >.. -t 


Reading for Literary Experience 














1992 Public 














Louisiana 


! 207 < 1.3) 


163(2.1) 


184(2.1) 


209 ( 1.9) ft 


231 ifrsim 


250 ( 0.8)-:4 


Southeast 


212 (2.4) 


164 (:2I7) 


189(3.7) 


215(2:7) 


237 ( 2.6) 


257 ( 2.6) 


Nation 


§ 217 ( 1.0) 


169(1.7): 


§;i94iflin|: 


.219(1:1) 


242 (1.3) 


262(1.6) 


1994 Public 


§■?: 












Louisiana 


1 1188 f 1i5) < 


.> ; ;443:(:2.3):;i 


ft 170 ( rs) < 


; 200 (il4) < 


228 ( 1.7)Sji 


251 (22) 


Southeast 


! 210 ( 2 3) 


156 ( 3.7) 


184(3.1) 


213(2.3) 


239 ( 3.1) 


260 ( 2.7) 


Nation 


f 214 { 1.2) 


>r157;(;2L2)i< : 


189(1.6) 


219 (1.1) 


244 ( 1 JZ) 


264 (1.3) : 


Reading to Gain Information 














1992 Public 




' f 










Louisiana 


• 199 (1-3) 


153(1.8) 


175(1.3) 


200 ( 1.8) 


224 ( 1.7) 


246 ( 1.8) 


Southeast 


l 208 ( 2.7) 


159 ( 3.5) 


-183 ( 3.4)#; 


i 210 ( 312) i 


; : 234 f3.0)pi 


255 ( 3.6) 


Nation 


f212<1.2) 


162 ( i;8) 


; 187 ( 1.4)1 ; .t 


. 214 ( 1,2) 


238(1.3) 


259 ( 1-9) 


1994 Public 














Louisiana 


1 195 ( Ii5) <:- 


•143 ( 3.0) < 


169 (2.1) ft 


195 (1.4) ; : 


:• : 223:(<i^)^'i 


246 ( 1.7) 


Southeast 


1 205 ( 2:0) 


149(2.5) 


178 ( 2.6) > 


207 ( 2:1) : 


.234 ( 1.6) : 


257 ( 20) 


Nation 


210 (1*2) 


151 ( 2.0) < 


183(1.4) 


^..214 (,1.5);;: :: 


240 ( 1 JS): 


262 ( 1.4) 

















The NAEP “purpose for reading” scales range from 0 to 500. The standard errors of the statistics appear in parentheses. 
It can be said with about 95 percent confidence that, for each population of interest, the value for the entire population 
is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error 
of the difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school 
students in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 
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CHAPTER 2 



Reading Proficiency of Fourth-Grade 
Students by Subpopulations 

The overall reading proficiency of students across the country presented in the 
previous chapter provides a global view of the state of reading performance. However, 
it is also important to look more closely at the performance of subgroups and to consider 
how different groups of children are progressing in reading. This information can 
provide educators, policy makers, and concerned citizens with important knowledge 
about how well students from different backgrounds and with different experiences are 
developing as readers. 

The 1994 Trial State Assessment Program provides additional information about 
the reading proficiency of important subpopulations by reporting on the performance of 
various subgroups of the public school student population defined by race/ethnicity, type 
of location, parents’ education level, and gender. In addition, because non-public school 
students were sampled in the 1994 Trial State Assessment Program, the results for 
non-public school students as well as those for the combined public and non-public 
school populations are reported. 

Race/Ethnicity 

The 1994 Trial State Assessment Program results for different racial/ethnic groups 
can be compared when the number of schools and students in a racial/ethnic group is 
of sufficient size to be reliably reported. (See Appendix A for details.) Table 2.1 
presents reading proficiency results for White, Black, and Hispanic fourth-grade public 
school students from Louisiana. 

1994, Public School Students 

As shown in Table 2.1, the average reading proficiency of White 
students in Louisiana public schools was higher than that of Black and 
Hispanic students. 
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1992 vs 1994, Public School Students 
There was a decrease in the average reading proficiency of Black public 
school students in Louisiana from 1992 to 1994. There was no 
significant change in the average reading proficiency of White or 
Hispanic public school students in Louisiana from 1992 to 1994. 
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TABLE 2.1 

Distribution of Reading Proficiency for Fourth-Grade 
Public School Students by Race/Ethnicity 



1994 Trial State Assessment 


Average 

Proficiency 


10th 

Percentile 


25th 

Percentile 


50th 

Percentile 


75th 

Percentile 


90th 

Percentile 




White 






• [ ! | • 










1992 


Louisiana 


21 6 { 1.2) ; 


177(2.1) 


196 (1.6) 


217 < 1.5) 


236 (h:3) 


! 254 (1.8)' ■ 




Southeast 


220 < 3.4)^ 


177(3.7) 


199 (. 4.2) 


222(23) 


242 ( 3.2) 


261 :( 4;i):;; 




Nation 


223 ( 1:3):-^ 


180(2.3)*^; 


;202:( 1:4) 


225(1.6) 


246 (1.3) 


:• 264 ( 1.6); 


1994 


Louisiana 


1213 { 1:4) 


.169 (;:L9)^ 


191 2.2) 


215 (1:6) 


; ':..238r(i;li2)^£ 


256 ( 2.3) #. 




Southeast 


..2t9:( 2.4)<|;-j 


170 ( 4.7) 


196 ( 3.5) 


222: ('3.7) 


244 (2 2) . 


264 (r4.o)r- 




Nation 


223(1.3); : 


;i75(2.3)r 


201 L7L : ! • 


226 (1,4) 


?47( r l:1) 


266(r2.4)/f 


Black 






; "y • • ~‘i 


. .- 




\£X- ! 


iHjj .1;?^ 


1992 


Louisiana 


191 (1.5) 


152(2.4) 


171(1,9) 




211(1.8) 






Southeast 


194(2.4)®'! 


150(7.2) 


•i:.:i72:(:'2.9)"- : -- ' 


195 { 3.4) ':!;: : 


...216( 3:1) , 


237(4.6)!r: 




Nation 


192 (1.6):^, . 


;148( &5) 


iy 169 ( 3.0) L 


193(2.0):;; !, 


215; (2.6) 


235 < 22):;;-: 


1994 


Louisiana 


180 < i;6)IS8i 


136Tt3.8) < > 


15T(:2J)5h 


; i8i (i.4) < 


! 203 ( £2) ' 


223 ( 2^)1;-. 




Southeast 


188(2^)=^: 


139 ( 2.1) 


163 ( 2.8) #; i 


189 (3.6)#® 


#215!:(I2£)M ; ; 


;238 ( 4.2) T: - 




Nation 


186 < 17);t;; 


135(31) 


160 (:1.9)T. ! ’;j 


187 (1.9) 


213 ( : - 


j 234 ( 2:3) V: 


Hispanic 


.. , : : f . 








yfjpr ' \ : 


kLuh# a. 


1992 


Louisiana 


188 ( 4.4), 


':;14T:(l2i2)i ;:: 


163 ( 4.0) 


191 ( 9.8) 


■:.:216T35): y!J: 


233(2.0) 




Southeast 


194(5.0)!;;:. 


141 (269)1 


167 ( 7 5)1 


136 ( 4.4)1 i > 


223 ( 3.7)1 


241 (612) t 




Nation 


199.(2^)gc; 


:”151:(l4.2) V;:;;: 


175(2.4) 


.200 ( 3.7} . 


225(3.9) 


• -245 (.2.4):#: 


1994 


Louisiana 


175 ( 5.0) ;3I|- 


122 (14.3) 


146 ( ; 7.8) •• 1 


: : 177$6J2):S'^ 


205 (:8;1)lS. 


225 (: 6.6) 




Southeast 


184 (4.1) 


:i137.;(7 15) 


157 ( 4.7) ; 


;;i82 < 53) ‘ 


. 211 (^4.3)L:h:U; 


,235 ( 9.4)=ii It 




Nation 


188 ( 2.7) :<:£ 


:;i34(4.7):r : ;= 


160 ( 3.5) < 


189(42):...; 


217(36):;® 


242!( 3;6) H -i: 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. ! Interpret 
with caution — the nature of the sample does not allow accurate determination of the variability of this statistic. 




34 



THE 1994 NAEP TRIAL STATE ASSESSMENT 



Louisiana 



Type of Location 

Table 2.2 presents the reading proficiency results for fourth-grade students 
attending public schools in central cities, urban fringe/large towns, and rural areas/small 
towns. 



1994, Public School Students 

The results indicate that the average reading proficiency of Louisiana 
students attending public schools in central cities was lower than that 
of students in urban fringe/large towns but was not significantly different 
from that of students in rural areas/small towns. 

1992 vs 1994, Public School Students 
From 1992 to 1994, there was a decrease in the average reading 
proficiency of students attending public schools in central cities in 
Louisiana. From 1992 to 1994, there was no significant change in the 
average reading proficiency of students attending public schools in urban 
fringe/large towns or rural areas/small towns in Louisiana. 




Distribution of Reading Proficiency for Fourth-Grade 
Public School Students by Type of Location 



1994 Trial State Assessment 


Average 

Proficiency 


10th 

Percentile 


25th 

Percentile 


50th 

Percentile 


75th 

Percentile 


90th 

Percentile 




Central City 










*d; : i ; 


•' ■■ 


1992 


Louisiana 


200(2.8) 


154(3.9): 


176 ( 2-7) Vp 


200(2S)ffi 


225(3.3). 


246(32) 




Nation 


207(15) 


i 159*26)?- : 


183 ( 216) : : 


209 (1.9) ^ 


232( 1.9) 


253 ( 2.6) 


1994 


Louisiana 


190 (:2.7).< 


i 135(6.1) N-l-l: 


161 (3.4) <. 


! 190(2B)Si : 


219 ( 3.0) 


245( 4:7) v 




Nation 


203 ( 2.4) 


:145:( 2,6) < ; 


V174(3;l).::4 : :l 


: : 208 ;( :3.0)|4j 


235 ( 27) 


256 ( 2.0) : 


Urban Fringe/Large Town 






.w'L; : ' - j 


ri-i 


i.Tf. h"4 : ; ; • 1 




1992 


Louisiana 


207 ( 1.9) 


:'::i66:(i2.8)«S ; ! 


186(1.7) : 


208 (1.8); 


228 ( 2.9) 


.246*1 .6) 




Nation 


219(2.2) 


; 173(4.4)ffr;. 


^196.|2.0)^-: 


222 ( 2.6) ; ' 


; 245 (1.9) 


263 ( 4.5) ; 


1994 


Louisiana 


! 203 ( 3:1) 


•155(4.1)3:4 


4-179 ( 4.9);^ : 


205 ( 2.9 )W 


i 229 ( 23)4 


250 ( 33) 




Nation 


219 ( 1.9) 


: •;166 (:4.1)i.f 


196 f3.0) : 


223 :( : iii)54i 


246(1.7) 


265 ( 3:0). 


Rural/Small Town 








■ [yj] : ; j 






1992 


Louisiana 


204 (1.9) 


•163(2.5),;; 


183(3.5) 


204(.23);4i 


:227;( 1.9): 


244(23) 




Nation 


217(25) 


173(2.8) 


196 ( 4:4)^ • 


220 ;( :27) j; ; 


240 (;24) 


256 ( 3.9) 


1994 


Louisiana 


! 197(2.7) 


'150. ( 4.5) / 


173 ( 2.4) i 


198 ( 32p!i 


223(26) 


243 ( 25): \ 




Nation 


| 213(1.8) 


162(3.0) 


189 ( : 2.8) 


217(1.8) 


240 ( 2.1) 


260 ( 2.1). : 



School sample size is insufficient to permit reliable regional results for type of location. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 
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Parents’ Education Level 

Previous NAEP findings have shown that students who report their parents are 



for fourth-grade public school students reporting that at least one parent graduated from 
college, at least one parent had some education after high school, at least one parent 
graduated from high school, neither parent graduated from high school, or they did not 
know their parents’ education level. Note that a substantial percentage of fourth graders 
indicated that they did not know their parents’ education level. Furthermore, research 
suggests that some fourth graders’ reports on parents’ education level are almost 
certainly not accurate descriptions of their parents’ actual education levels. 19 Such 
considerations should be kept in mind when interpreting fourth grade proficiency results 
for different parental education levels. 



As shown in Table 2.3, public school students in Louisiana reporting 
that at least one parent graduated from college demonstrated an average 
reading proficiency which was lower than that of students who reported 
that at least one parent had some education after high school, did not 
differ significantly from that of students who reported that at least one 
parent graduated from high school or they did not know their parents’ 
education level, and was higher than that of students who reported that 
neither parent graduated from high school. 



Public school students in Louisiana who reported that they did not know 
their parents’ education level had a lower average reading proficiency 
in 1994 than in 1992. The average proficiency of public school students 
in Louisiana who reported that at least one parent graduated from 
college, at least one parent had some education after high school, at least 
one parent graduated from high school, or neither parent graduated from 
high school did not change significantly between 1992 and 1994. 



18 Ina V.S. Mullis, Jay R. Campbell, and Alan E. Farstrup. The NAEP 1992 Reading Report Card for the Nation and the 
States. (Washington, DC: National Center for Education Statistics, 1993.) 

19 

E. Dianne Looker. “Accuracy of Proxy. Reports of Parental Status Characteristics,” in Sociology of Education, 62(4). 
(1989). pp. 257-276. 



better educated tend to have higher reading proficiency. 18 Table 2.3 shows the results 



1994, Public School Students 



1992 vs 1994, Public School Students 
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TABLE 2.3 

Distribution of Reading Proficiency for Fourth-Grade 
Public School Students by Parents’ Level of Education 



1994 Trial State Assessment 


Average 

Proficiency 


10th 

Percentile 


25th 

Percentile 


50th 

Percentile 


75th 

Percentile 


90th 

Percentile 




College graduate 












; 1: ■ 


1992 


Louisiana 


206 < 2.1) ; 


160(!4.9):LS 


'183(3.3) 


208 ( 2.4) 


. : .i 231. ( 2:1) : 


250(57) 1 




Southeast 


218 ( 2.8) i;: 


171: ( 4.5) . / 


194 ( 4.6) vf. 


221 (2.4) 


244 ( 4.8) 






Nation 


223 ( 1.6) 


175 ( 3.5) 


;200,(2:i):;f j 


226 ( 2.1) 


. : : ;249..('1^4)' : . 


267. (2.4) 


1994 


Louisiana 


200 (:Z2) >&: 


:'i46 |.6.o) ; y^ f 


'171 (3.9) • 


201 :< 2.4) 


229^(4.0) 


25li(4:9>td : 




Southeast 


216,( 3.0) 'H-; 


160 (:3.3); = : : ; 


190- (5.0) : 


219(3.7) 


245 ( 3.5) 


265^( 2:8) y 




Nation 


222(1.4) 


168 ( 1.9) . . 


1199 ( 1 .4) 4-;:; 


: 227 (v1;7) 


: ; 249; (1:8): 


: \i 269'( 1.6) ; 


Some 


education after HS 


r '• :j v:/ ; ;:: - 


■ • ; • : . • ' ; 






-V"& 


' ..IS = • : : .M 1;! 


1992 


Louisiana 


215(2.3) 


; 170 ( 7.0) SI 


|l92 ( 5.7) 


217 ( 4:1) 


239 ( 3.4) 


258: ( 4^7)' : ; 




Southeast 


216 ( 4.7) ^ 


167(7.1) 


1194 ( 8.4) ^ 


216T( 52) 


241 (73): 


259 (11.0) £| 




Nation 


221 (2.4) 


: 177(9.0) ; 


201 (3.3) 


223 : {23) 


245(3.6) 


: ; 264 T 7.5) .: | 


1994 


Louisiana 


209 ( 2.6) 


1 55 '(. 6.8)5^5- 


:183 ( 


: 214 (:3.8) 


237(( :1.9) 


; 258 ( 4.6)1 1 




Southeast 


222 { 3.0) 


173(7.0)!*: 


£199 (20.4) 


: 226 ( 7.8) 


248 ( 6.7) 


k: : 269 (10.8) I 




Nation 


222 ( 22) Jr. 


• i7i: (9;6)1|;; : 


199 (4.3) 


226; (33) 


Jr 240i(!3:i) 


266 ( 3.9) j 


High school graduate 


;■ ■ : 




, l ' 




1 Ij-Sv $ 


, J 




1992 


Louisiana 


201 (SavSr 


: 159(5 :i) :! :S : 


® 80'( 2,3):fS ; 


;;:202;( 27) 


223 (|:1.9) 




'241H2.3) / ; 




Southeast 


207 ( 4.3) , 


160 ( 6.3) N" 


1182 ( 8.1) &;/ 


210(4.7) 


231( 52) i j : 


|250 ( 4.4) : j 




Nation 


211 { 1.8):-:J. 


165 (1.6) jj;: 


190( 2.8). 


21 4?(:2.6) 


ii: ; : 234(2.6) 


252 ( 23) 


1994 


Louisiana 


196(2.1) V 


■ 144 (5.0):/ f 


r 170 ( 2:6) 


198(2.7) 


223 ( 2.8) 


245(7.8) 




Southeast 


207 ( 35) : 


1158 (15.1); 


: 1844( 7 2) :Jy: ; 


210(4.5) 


?■ 230(i6.5): 


250 ( 8.9) £ 




Nation 


206. ( 1 .9) J'f: 


149 ( 3.0) <|1 


£l8lf(.2.6) 


212;(!0.8) 




235 ( 2.4) : ; t 


255 ( 4.0) iii 


High school non-graduate 


: * 


% 


££ : i i '£\ f ;| ‘ : ' f ^ ;•?’ 


vjlx llr j j: . 


| 


* 


r : j t’J 


1992 


Louisiana 


'196 ( 2 J2) 


158(9.1) 


"176 ( 2 1) 


196(2.5) 


216(:3.6) 


236 ( 4,1) 




Southeast 


197(3.8 pt* 


: 155 ( 8.7) ' 


1175'C.9:7)-^;iy 


:198 ( 4.4) 


220 ( 6.7) : 


2^ (6.3) ; 




Nation 


-197 (27) J :- 


154 ( 5.7) 


Vi-75 (:7^)1?j 


199(3.1) 


■Jl 221 (7.9) 




241 (S:i) 


1994 


Louisiana 


188(2.4) 


144(55) S 


186 ( : 6'5).:>tiS 


190(1.3) 


ikl: 212:(32)V 


/•l£S234::('6.1) /■*: 




Southeast 


186 ( 4.8) ••vf 


139(24.0): 


lr.:163 ( 8.9) 


f ii86 ( 9.1) 


212(7.8) 


232 ( 4.0) 




Nation 


188(35) 


137i^7.3)ji.|| 


| i 82 ( 8.8) 


188:(:2.9) 


. 216 ( 4.3) 


236 ( 4.3) 


1 don’t 


know 






; SV \-' ‘i* Si 








th\: 


1992 


Louisiana 


201 ( 1 2)sS 




i8o 


202 (12) 


Mt 


223 (: 1:3) 




241: (2.9) 




Southeast 


205 ( 25) in- 


160 ( 3.6) ; 


185 ( 3.7) !//: 


208 ( 5.4) 


/.it 


229 (:2 .4) 


244(4.1) 




Nation 


209(1.3) Jy 


163 C1.9);lU; 


187(1,8) 


212(15) 


232 (jl 7) 


251 ( 22) 


1994 


Louisiana 


194 ( 2.6) < 5 


144 ( 4.9) ‘4 


170 ( 3.6) 


196 ( 2.7) ! 


219 (1.9) 


240 ( 4.1) 




Southeast 


200 ( 25) 


146 f 4.8) 


174 ( 2.9) K 


203 { 4.4) 


228 ( 2.5) 


247( 4.2) V: 




Nation 


204 ( 1.3) ' : 'v 


150 ( . 3.1) <v: 


) -179 ( 2.2) 1; 


208(1,1) 


234 (1.6) 




253 ( 1 .9) Si 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 
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Gender 

In general, NAEP reading assessment results for males and females support 
numerous studies that have revealed gender differences favoring females in reading. 20 
As shown in Table 2.4, the 1994 Trial State Assessment Program results for Louisiana 
are consistent with those general findings. 

1994 , Public School Students 

In public schools in Louisiana, girls exhibited an average reading 
proficiency which was higher than that of boys. 

1992 vs 1994 , Public School Students 
In Louisiana public schools, the average reading proficiency for boys 
was lower in 1994 than in 1992. Similarly, the average proficiency for 
girls was lower in 1994 than in 1992. 
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TABLE 2.4 

Distribution of Reading Proficiency for Fourth-Grade 
Public School Students by Gender 



1994 Trial State Assessment 


Average 

Proficiency 


10th 

Percentile 


25th 

Percentile 


50th 

Percentile 


75th 

Percentile 


90th 

Percentile 




Male 














1992 Louisiana 


200(15) 


f 156 (:2:.i) 


177(11.7) 


‘201 <i115) 


224 ( 2.0) 


243(1.9) 


Southeast 


205(2:9):#-'/. 


154 ( 4.3) r 


179(4.1)® 


• 206 ( 35) . 


231i>(:4l3)L:i~ 


250(319) 


Nation 


211 (i;3);^; : ::; 


163;(;2i1) 


188 (1.9) 


213:(;:114) 


237 ( 2.0) 


256 ( 2.4) ‘ 


1994 Louisiana 


193 ( 1,6) < 


V;141:(;25):< : 


166/( 25) < : 


195(25) 


221 ( 15) : :.l; • 


244 <1J2j nil 


Southeast 


202(25) 


: 145: ( 3.3) :: 


174: (:2;9) 1 


204 ( 2.3) 


231 (312) 


254(4.2) 


Nation 


207(45);® 


149 (118) < 


181(1.0) <f 


211 (15) 


237:( 1 2) 


257 ( 119) ’ 


Female 




v- ■ 










1992 Louisiana 


207( 1.3) 


167 ( 2.6) 


186U/12) 


208(1.2) 


229.(:T.9)i;/f : 


247 ( 2.4) : ; 


Southeast 


2t6:(2;5) 


.175 ( 3.8) 


194 ( 3.4) 


218(2.8) 


238 ( 3.9) 


258 ( 4.3) 


Nation 


219.(1.1), 


173 ( 2:1) 


197 ( 2.0) 


221 (1.1) 


243 ( 1.6) <1 r 


262 (1.7) 


1994 Louisiana 


200 ( 1.7) < ; 


151 ( 3.3) < 


175 ( 3.1) < 


201(2.1) 


226 ( 2.8) 


248 ( 1.5) : 


Southeast 


215 ( 22) : 


165(2.4) 


189(2.1) 


217 ( 2.5) 


240 ( 3.5) 


261 (2.7) .{ 


Nation 


218(12) 


165 ( 116) < 


194(2.0) : 


222(2.3) 


245^(1. 4): 


264 ( 2.1) 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 



Proficiency According to Purpose for Reading 

Table 2.5 provides a summary of results according to each of the two purposes 
for reading by race/ethnicity, type of location, parents’ education level, and gender for 
public school students. 




20 

Ian Plewis. “Pupils’ Progress in Reading and Mathematics During Primary School: Associations with Ethnic Group 
and Sex,” in Educational Researcher, 33. (1991). pp. 133-140; Gita Z. Wilder and Kristin Powell, Sex Differences in 
Test Performance : A Survey of the Literature . (New York: College Entrance Examination Board, 1989). 
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TABLE 2.5 

Fourth-Grade Public School Students’ Average 
Reading Proficiency According to Purpose for Reading 
by Subpopulation 



RA CE/ET HNICITY 
White 


Louisiana 

Southeast 

Nation 


Black 


Louisiana 

Southeast 

Nation 


Hispanic 


Louisiana 

Southeast 

Nation 


TYPE OF LOCATION 


* 


Central City 


Louisiana 

Nation 


Urb Fringe/Lrg Town 


Louisiana 

Nation 


Rural/Small Town 


Louisiana 

Nation 


PARENTS’ EDUCATION 


College graduate 


Louisiana 

Southeast 

Nation 


Some educ after HS 


Louisiana 

Southeast 

Nation 


HS graduate 


Louisiana 

Southeast 

Nation 


HS non-graduate 


Louisiana 

Southeast 

Nation 


1 don’t know 


Louisiana 

Southeast 

Nation 


GENDER 

Male 


Louisiana 

Southeast 

Nation 


Female 


Louisiana 

Southeast 

Nation 



225 (113) 


-d- 5U '224 ( 1 -4) : 


: 194 (1.7) 


■•4 *'-181 ( 1.9)'C: 


196,(2:3) = ; 


i;i 92 ( 2.8) 


195(1.6) !• 


ia’fK&W ( 2.1) :; 


191 ( 5.1):. 




195(616)! 


187 ( 4.3) 


204 ( 2,5) 


; 1191; (,2.8)< 4.1 


204.(2.8) 


: ' r 1 • :i: ; 191!|i2.9):W--'- 


210(11.5): 


206 ( 2.6) 


210(1.8) 


J 206 (13.5) : 


221: ( 2.1) 


; ’220 ( 2.0) 


207 ( £2) 




220(2.2) 


it ';i:r2ie;(:2.o)^;: ; 


209 ( 2,1)kM1 


S :;"2oo( 2js)m : 


220 (;2.7)T ,* 


'.#*218 ( 3-5) 


: 225T* r 6N.^ 


":-|:;,; , ;i224( 1.5) 


218 (;2.5): 




218 ( 5.3) ! 


i; 227(3.1) 


224(218)’ 


;• 224 ( 2.4) 


205 (12.2)- 




,210 ( 413) * 


' -::120S ( 4J3) : t - 


214(2.0);; 


; : ':^:'208(:2.l)T# } i 


201 (2,6) 


2 cit i90C3^) b W 


200 ( 3.7) 


V ' ; K186 ( 418) 


2021(3.0) 


89;, (13.4) 


205 (-1.4) 


•ii96:(:2.1):i<i:l 


207 ( 2.8) 


203 ( 2.9) '-.Vi 


212 (113) 


: 207,(::T.3);lf;C>-. 


2031(1.7): 


| : 194 ( 4.8) <vi: 


206 ( 3.1) : 


111' 203 ( 2.7)M-::< 


213 (1.5) 


H02O .f i 


212 (113) : 


" 203 (1.9) < 


219(2.3) 


•I. 219(2.5) 


222 (1.0) 


: 1 • 221 :( 1.3) 



:: . 212 (1.4) : 


; 211(117) 


,'^ 218 : ( 3.6) ill -1 .-) 


217(2.8) 


: t:;K22K(-116):.li;t : ;;'j 


: 220( 1.4) 


%:i86( n7)ii- ; ': l| 


1-178 ( 1.9) < 


192 ( 2i3) = : 


t?* 194 ( 2.5) ■? 


; 188(1.9) 


181 (1.6) < 


184(4.8) 


175 ( 5S) 


‘ ;il93 ( 315)!;: 1 


180 ( 4.3) rl- 


: : :i93(;2^) ;] 


L 185(2.7) 


; 196 ( 3.0)1- : 1 


[I 187(2.9) 


•ii-203 (1 : l8) ;in v. j 


201 (2.3) 


: Cl202.(:2l3) • '• 


200 ( 3.1) 


Jl:;.-217 { 2.4) 


217 ( 2.1) 


200.(2.1) 


h 197(3 S) 


214(3.0) 


. 210 ( 2.1) V 


iV .202X214) -'V! 


; 199.( 2.3) 


217(3:1) 


• I. 214(2.6) 


:,:c,22i;:CX7);:- 


1220 ( 1 .4) 


/' • 211 (2.4) ' ' 


: 206 ( 3.4) 


;^:213(4.6).i-C; 


217(4.4) 


; V218 ( ZJZ) . ■ ' 


218(2.5) 


! -.196 (is) >: j 


1195( 211) .. 


d-204 (AJ6)H 


205 ( 4.0) 


■1 -207 (.2.0)' \> | 


205(2.0) 


M&iii (2S) ; J 


Ldl 85X2.5) - 


:^>-193-(.44H : -:". : ! 


188(518) 


s 192 (2.7) 


= 186 ( 4.4) ; 


; d 197 1 ( 1-3) 1 


191( 2,1);:' 


Kr.203(ZS)M^\ 


196(2.9) 


d 206.(1,5) Mr] 

.t ” *; ; j 


! j 1201(1:6) 


; '! 197:( 116) 


L 193(1.7) 


I 203f( 2.9) : I : .; : l! 


200 ( 2.7) j; 


S;209K^1.l5);^4-l 


206 ( 1,5) i i';; 


T-i’' 2021(1 : l 


. 197 [l. 8): C 


2T3 .{:2i9)X\. : 1 


210(2.1) 


215 ( 1;4) ?v:i i 


214 (IS) 



Reading for Literary Experience 


Reading to Gain Information 


1992 


1994 


1992 


1994 



Proficiency 



219 ( 1.3) ; ; ; ^215 { 1.6) 



* School sample size is insufficient to permit reliable regional results for type of location. 

The NAEP “purpose for reading” scales range from 0 to 500. The standard errors of the statistics appear in parentheses. 
It can be said with about 95 percent confidence that, for each population of interest, the value for the entire population 
is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error 
of the difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school 
students in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 
! Interpret with caution — the nature of the sample does not allow accurate determination of the variability of this 
statistic. 
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Reading Proficiency of Non-Public School Students 

The 1994 Trial State Assessment Program marks the first time that non-public 
school students were assessed at the state level. Therefore, separate non-public school 
results can be reported for Louisiana. Also, results based on a combined sample of 
public and non-public school students can be presented. Trend results are not presented 
for non-public school students because they were not included in the 1992 samples. 
Table 2.6 shows the distribution of overall reading proficiency for non-public school 
and combined populations in Louisiana, the Southeast region, and the nation. The 
corresponding results for public school students are presented in Table 1.1. 

1994, Non- Pub lie School Students 

The average reading proficiency of fourth-grade students in non-public 
schools in Louisiana was 227 . This average was not significantly 
different from that of non-public school students across the nation (231). 

Public and Non-Public School Student Comparison 
The average reading proficiency of fourth-grade students in non-public 
schools in Louisiana was higher than the average for public school 
students (227 for non-public and 197 for public). For the nation, the 
average reading proficiency for non-public school students was higher 
than that of their public school counterparts (231 for non-public and 212 
for public). 

1994, Public and Non-Public School Students Combined 
The average reading proficiency of grade 4 students from Louisiana was 
202. This average was lower than that of students across the nation 
(214). The lowest performing 10 percent of fourth graders from 
Louisiana had proficiencies at or below 149 while the top 10 percent 
had proficiencies at or above 251. The lowest performing 10 percent 
of students across the nation had proficiencies at or below 159 while the 
top 10 percent had proficiencies at or above 263. 




1994 Trial State Assessment 



1994 Non-Public 

Louisiana 

Southeast 

Nation 

1994 Combined 

Louisiana 

Southeast 

Nation 



TABLE 2.6 



Distribution of Reading Proficiency for Fourth-Grade 
Students, Non-Public and Combined Schools 



Average 

Proficiency 


10th 

Percentile 


25th 

Percentile 


50th 

Percentile 


75th 

Percentile 


90th 

Percentile 




227.^3:e)n-py 

236 ( 5.8) 4: 
231(2.5) 


'186 ( 

196 (23.7) i; 
1 88 ( 4i2) ;f 


207 ( 4.3) 
2171(2.8):*? 
2ir-;( 2.5) f 


229 ( 218) 
236(3.6) 
; 233 ( 2.3) 


249 (5.3) :: 
260 { 3.9) r 
254( 


267 (3.1) 
278 (1017) : 
272 ( 2.7) 


202(1.4) ,1 
2101(1 2.0);i=h 
214 ( 1.0) 


149 ( 2.4) : 
156(4.2) 

; 159 ( C6):-?: 


175 (1.3) 
184 ( 2.3) 
189 ( 1.2) 


203 ( 214) 
214(2.3) 
• 219(111) 


230 (1.9) 
1238 (2.5) 
243(11.1) 


251(113) ! 

260( 118 ) ; 
263 (1.5) 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). 
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Table 2.7 presents proficiency by purpose for reading for both the non-public 
school and combined populations. The corresponding public school student results can 
be found in Table 1.2. 



1994, Non-Public School Students 

The proficiency of non-public school students in Louisiana in reading 
for literary experience (227) was not significantly different from that of 
students across the nation (233). Similarly, in reading to gain 
information, the proficiency of Louisiana’s non-public school students 
(226) did not differ significantly from that of students across the nation 
(229). 



1994, Public and Non-Public School Students Combined 
The proficiency of Louisiana students in reading for literary experience 
(203) was lower than that of students across the nation (216). Similarly, 
in reading to gain information, the proficiency of students in Louisiana 
(200) was lower than that of students across the nation (212). 
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TABLE 2.7 

Distribution of Reading Proficiency for Fourth-Grade 
Students According to Purpose for Reading, 
Non-Public and Combined Schools 





Average 

Proficiency 


10th 

Percentile 


25th 

Percentile 


50th 

Percentile 


75th 

Percentile 


90th 

Percentile 


Reading for Literary Experience 








;; 




- •: • 


1994 Non-Public 












’ • \ ; • :i 


Louisiana 


227 ( 4-1) 


183 (9.7) 


206(5.9) 


230 ( 5.1) 


250(2.3) 


270 ( 3.6) 


Southeast 


238 ( 5.3) 


197 (19.5) 


218(6.2) 


239 ( 33) 


262 ( 6.7) 


280 ( 6.6) 


Nation 


233 ( 2.5) 


189;('4.7) ||.r : 


212 (3.1) 


234 ( 2.1) 


256( 23) | 


275(1. 8) 


1994 Combined 






'k> 






, . • ~ , % 


Louisiana 


2D3 { 


146 02.7) 


175 (1.5) 


205 ( 1.9) i 


:r Z33i{ZA)^ 


255 ( 21) 


Southeast 


213(23) if 


158(2.4) 


186 ( 2.8) '*>. 


216 ( 25) 


; 242 | 2.6)i€t 


. 263:(2 3)'& 


Nation 




ISO (1.0) ; ; 


191 (13). 


221 (i5) 


245 ( 1.4) 


265 ( 1.2) S 


Reading to Gain information 








1 : .-a i : ; 






1994 Non-Public 














Louisiana 


226 (3:7) 


18t:(:8.6) ^ 


204 ( 4 7) 


228 ( 3.9) 


(33)i- 


268 ( 6.0) 


Southeast 


234(6.6) 


187 (18.1) : 


212 ( 3.6) 


234 ( 3.9) 


259 ( 8.4) r 


280 ( 8.0) 


Nation 


229(2.6):: 


183 ( 7.3) 


207. ( 3.0) { 


230:(3.1)i| 


r253{-2.6):# c 


273 ( 2-8) 


1994 Combined 














Louisiana 


200 <15) 


146(3.0) 


173 (15) 


201 (2.1) 


. 229 :(.2:4);'v - 


252 ( 1.8) i ? 


Southeast 


207 ( 2.0) ; 


151 (2.8) 


7 180 ( 3.4) 


209 ( 2.4) 


236 { 21) 


260 ( 23) ; 


Nation 


212< 1.0) 


154(2.3) 


185 (15) 


216 (1.1) 


242 < 1.0) 


263 ( 1.4) N: 



The NAEP “purpose for reading” scales range from 0 to 500. The standard errors of the statistics appear in parentheses. 
It can be said with about 95 percent confidence that, for each population of interest, the value for the entire population 
is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error 
of the difference (see Appendix A for details). 
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PART TWO 



Reading Achievement Levels 

hile providing information about what students can do in reading is essential 
for understanding the current state of reading performance, it is also important to 
determine whether students’ present performance is adequate. Knowing what students 
can do is made even more relevant by also looking at what students should be able to 
do . For that reason, the National Assessment Governing Board (NAGB) has provided 
NAEP with achievement levels in reading that set standards for performance in reading 
at grades 4, 8, and 12. 

This report presents data using the student achievement levels as authorized by the 
NAEP legislation and adopted by the National Assessment Governing Board 
(NAGB). 21 The achievement levels are based on collective judgments, gathered from 
a broadly representative panel of teachers, education specialists, and members of the 
general public, about what students should know and be able to do relative to a body 
of content reflected in the NAEP assessment frameworks. For reporting purposes, the 
achievement level cut scores are placed on the traditional NAEP scale. For each grade, 
the results divide the scale into four ranges — Basic , Proficient ; and Advanced , as well 
as the region below Basic . 

Initiated in 1990, the levels have been used to report the national and state results 
in mathematics in 1990 and 1992, as well as in reading in 1992 and 1994. The reading 
achievement levels were developed by American College Testing (ACT) under contract 
with NAGB. While setting student achievement levels on the National Assessment is 
relatively new and developing, the achievement levels are consistent with recent 
education reform efforts. . Some state and local jurisdictions are also developing 
standards and reporting their test results using them. 22 



P.L. 103-382. Improving America’s Schools Act of 1994. 

22 

States such as Kentucky, Maryland, Colorado, Connecticut, and North Carolina all have standard-setting initiatives 
resulting in student achievement levels. 
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Despite the commitment to standards-based reporting of NAEP data, the transition 
is incomplete. There have been some critical reviews and congress ionally mandated 
evaluations that cast doubt on the interpretability of achievement levels and also on the 



Academy of Education (NAE). 24 Their findings question, for example, the application 
of the Angoff method for large scale assessments like NAEP, given the significant 
modifications required to accommodate the complexity of the NAEP item structure and 
the multiple cutpoints. They conclude that discretion should be used in making 
particular inferences about what students at each level actually know and can do. In 
addition, there were concerns that the proportion of students at certain levels, but 
particularly at the advanced levels, may be underestimated. 

On the other hand, the Angoff procedure is the most widely documented, 
researched, and frequently used method in the standard-setting field. Many well-known 
experts support the use of a modified-Angoff method on NAEP. Several critics of the 
NAE studies, 25 for example, have reaffirmed the integrity of the process employed by 
the Board and have concluded that the weight of the empirical evidence presented does 
not support the NAE’s conclusions about achievement levels or the use of the 
modified-Angoff process. In addition, the Council of Chief State School Officers’ 
advisory panel of state assessment directors, fully aware of the NAE’s conclusions, 
supported the use of the achievement levels to report the 1994 reading results. 26 

Taken together, the results of the various studies suggest the need for further 
research and development. To that end, ACT, the NAGB contractor, recently conducted 
a study in anticipation of the 1994 NAEP reading reports. The study sought to examine 
the congruence between the reading assessment framework and the descriptions of 
reading performance embodied in the levels. 27 Two different methodologies were used: 
(1) evaluation of the achievement level descriptions via statistical item mapping, and (2) 
evaluation of the achievement level descriptions via judgmental item mapping. It was 
the consensus of the participants that the reading achievement level descriptions were, 
in general, consistent with the framework and the 1994 NAEP reading assessment 
results. However, minor modifications were suggested by the study panelists. These 
modifications were incorporated into the 1994 achievement level descriptions. 



23 

General Accounting Office. Educational Achievement Standards: NAGB' s Approach Yields Misleading 
Interpretations. (Washington, DC, 1993). 

24 

National Academy of Education. Setting Performance Standards for Student Achievement. (Stanford, CA: National 
Academy of Education, 1993). 

25 

American College Testing. Technical Report on Setting Achievement Levels on the 1992 National Assessment of 
Educational Progress in Mathematics , Reading , and Writing . (Washington, DC: National Assessment Governing 
Board, 1993); G. Cizak. Reactions to the National Academy of Education Report. (Washington, DC: National 
Assessment Governing Board, 1993); M. Kane. Comments on the NAE Evaluation of the NAGB Achievement Levels. 
(Washington, DC: National Assessment Governing Board, 1993). 

26 Education Information Advisory Committee of the Council of Chief State School Officers. A Resolution of the 
Education Information Advisory Committee. (Alexandria, VA, 1994). 

27 American College Testing. Technical Report on the 1992 NAEP Reading Re-visit Study. (Iowa City, 1A: American 
College Testing, 1995). 



applicability of the underlying technical methodology used to develop them. These 
studies were conducted by the General Accounting Office (GAO) 23 and the National 
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It should be noted that the ACT study did not address the applicability of the 
modified- Angoff procedure for the 1994 reading assessment. Nor did it focus on the 
reasonableness of actual achievement level cut scores. However, NAGB continues to 
explore new and innovative methodologies for standard setting for NAEP. In addition, 
proceedings from a standard-setting conference held in the fall of 1994, jointly sponsored 
by NCES and NAGB, are due to be released in the fall of 1995. Given the array of 
nationally known experts in attendance, the findings will undoubtedly provide additional 
insight into this issue. 

In sum, the student achievement levels in this report have been developed carefully 
and responsibly, and have been subject to refinements and revisions in procedures as 
new technologies have become available. However, standards-based reporting for NAEP 
data is still in transition. The NAEP legislation states that the student achievement levels 
shall be . . developed through a national consensus approach . . . used on a 
developmental basis, . . . and updated as appropriate.” It requires that their 
developmental status be clearly stated in NAEP reports. Upon review of the available 
information, the Commissioner of NCES has judged that the achievement levels are in 
a developmental status. However, the Commissioner and the Governing Board also 
believe that the achievement levels are useful and valuable in reporting on the 
educational achievement of American students. 

Part Two of this report focuses on results of the 1994 Trial State Assessment 
Program in terms of the NAGB achievement levels. Chapter 3 provides an overview 
of the achievement level descriptors. In addition, the percentages of public school 
students in Louisiana, the Southeast region, and across the nation who performed at or 
above each of the achievement levels in 1994 and 1992 are presented. Chapter 4 
expands on these results by presenting achievement level data for subgroups — 
race/ethnicity, type of location, level of parents’ education, and gender. Chapter 4 also 
presents results for students in non-public schools and combined results for both public 
and non-public school students. 
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CHAPTER 3 



Students’ Reading Achievement 

The most recent reauthorization of the National Assessment Governing Board 
(NAGB) continues the Board’s responsibilities to set policy for NAEP and to “develop 
appropriate student achievement levels for each age and grade in subject areas tested” 
(Pub. L. 103-382). As a result, students’ reading proficiencies presented in the previous 
section can be viewed in the context of established goals for performance. This report 
next presents results based on the National Assessment Governing Board’s goals for 
students’ achievement on the NAEP reading scale. 28 

Achievement goals are determined through collective judgments about how 
students should perform. These judgments are associated with specific points on the 
NAEP scale that serve to identify boundaries between levels of achievement for each 
grade — Basic, Proficient, and Advanced. Performance at the Basic level denotes partial 
mastery of the knowledge and skills that are fundamental for proficient work. The 
central level, called Proficient, represents solid academic performance. Students 
reaching this level demonstrate competency over challenging subject matter. 
Performance at the Advanced level signifies superior performance beyond proficient 
grade-level mastery. In this report, the proportion of students attaining the three 
achievement levels is presented for both the 1994 and 1992 assessments. 

Definitions of the three levels of reading achievement are given in Figure 3.1. 
Examples of questions at the achievement levels are also provided. The reading 
passages that accompany these questions can be found in Appendix B. It should be 
noted that constructed-response questions occur at all levels of reading achievement. 




28 



Appendix C briefly describes the process of gathering expert judgments about Basic, Proficient, and Advanced 
performance — as defined by NAGB policy — on each reading item, combining the various judgments on the various 
items and mapping them onto the scale, and setting the scale score cutpoints for reporting purposes based on these 
levels. 
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FIGURE 3.1 

Levels of Reading Achievement at Grade 4 

The following achievement level descriptions focus on the interaction of the 
reader, the text, and the context. They provide some specific examples of reading 
behaviors that should be familiar to most readers of this document. The specific 
examples are not inclusive; their purpose is to help clarify and differentiate what readers 
performing at each achievement level should be able to do. While a number of other 
reading achievement indicators exist at every level, space and efficiency preclude an 
exhaustive listing. The achievement levels are cumulative from Basic to Proficient to 
Advanced. One level builds on the previous levels such that knowledge at the Proficient 
level presumes mastery of the Basic level, and knowledge at the Advanced level 
presumes mastery of both the Basic and Proficient levels. 
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:: BASIC 
[LEVEL 
( 208 ) 



Fourth-grade students performing at the Basic level should demonstrate an 
understanding of the overall meaning of what they read . When reading texts 
appropriate for fourth graders, they should be able to make relatively obvious 
connections between the text and their own experiences and extend the ideas in 
the text by making simple inferences. 



For example, when reading literary text, Basic-level students should be able to tell what the story is generally 
about — providing details to support their understanding — and be able to connect aspects of the stories to their own 
experiences. 

When reading informational text, Basic-level fourth graders should be able to tell what the selection is generally 
about or identify the purpose for reading it; provide details to support their understanding; and connect ideas from the text 
to their background knowledge and experiences. 





Fourth-grade students performing at the Proficient level should be able to 


PROFICIENT 


demonstrate an overall understanding of the text, providing inferential as well as 


;f ; 'levelC 


literal information. When reading text appropriate to fourth grade, they should be 


able to extend the ideas in the text by making inferences, drawing conclusions, and 


I.;: (238): .. 


making connections to their own experiences. The connection between the text 




and what the student infers should be clear. 



Specifically, when reading literary text Proficient-level fourth graders should be able to summarize the story, 
draw conclusions about the characters or plot, and recognize relationships such as cause and effect. 

When reading informational text Proficient-level students should be able to summarize the information and 
identify the author’s intent or purpose. They should be able to draw reasonable conclusions from the text, recognize 
relationships such as cause and effect or similarities and differences, and identify the meaning of the selection’s key 
concepts. 



ADVANCED 
LEVEL 
( 268 ) ! 



Fourth-grade students performing at the Advanced level should be able to 
generalize about topics in the reading selection and demonstrate an awareness of 
how authors compose and use literary devices. When reading text appropriate to 
fourth grade, they should be able to judge texts critically and, in general , give 
thorough answers that indicate careful thought. 



Specifically, when reading literary text. Advanced-level students should be able to make generalizations about 
the point of the story and extend its meaning by integrating personal and other reading experiences with the ideas 
suggested by the text. They should be able to identify literary devices such as figurative language. 

When reading informational text. Advanced-level fourth graders should be able to explain the author’s intent 
by using supporting material from the text. They should be able to make critical judgments of the text (including its form 
and content) and explain their judgments clearly. 
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FIGURE 3.1 (continued) 

Levels of Reading Achievement at Grade 4 



The following questions were selected as examples of the types of questions that 
students at each of the three achievement levels can respond to effectively. The example 
questions were selected from the 1992 or 1994 NAEP reading assessments. These 
questions are based on the stories “Sybil Sounds the Alarm” and “Hungry Spider and 
the Turtle,” which are shown in their entirety in Appendix B. “Sybil Sounds the Alarm” 
is a fictional account of a historical event that describes the courage of a young colonial 
girl in riding her horse to warn of the approaching British army. “Hungry Spider and 
the Turtle” is a fable that presents a humorous portrayal of two characters and the jokes 
they play on each other. Both stories were used to assess reading for literary experience. 

For the multiple-choice questions, the correct answer is marked with an asterisk. 
For the constructed-response questions, a description of acceptable answers is provided. 
Also shown are the national overall percent correct and the percent correct for the 
students performing within the interval of the indicated level. For example, students 
with an average reading proficiency in the range 208-237 are in the Basic interval : at 
or above the cutpoint for the Basic level and below the cutpoint for the Proficient level. 

Samples of student responses to these and other constructed-response questions in 
the NAEP reading assessment appear in the Reading Assessment Redesigned 19 report 
which provides an in-depth look at the assessment materials and tasks. Also, a 
presentation of sample student responses can be found in the 1994 NAEP Reading Report 
Card . 



| BASIC 

| ' Example 


LEVEL 

Question 


Sybil Sounds the Alarm 


Sybil’s father thought that she 

A. was obedient but forgetful 
* B. was courageous and a good rider 

C. could lead the troops against the British 

D. could easily become angry 


1 992 Overall Percentage Correct 


1992 Conditional Percentage Correct = 
i for, Basic Interval 


. Nation 


71 (1.4) 


Nation 75 (2.4) 



29 J.A. Langer, J.R. Campbell, S.B. Neuman, I.V.S. Mullis, H.R. Persky, and P.L. Donahue. Reading Assessment 
Redesigned. (Washington, DC: National Center for Education Statistics, 1995). 
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FIGURE 3.1 (continued) 

Levels of Reading Achievement at Grade 4 



: - LBASIC .LEVEL. , 
Example Question 



Hungry Spider and the Turtle 



Who do you think would make a better friend, 
Spider or Turtle? Explain why. 



Acceptable responses indicated which character would make a better friend 
and provided appropriate evidence from the story in support of the 
selection. 



1994 Overall Percentage Acceptable - 


1994 Conditional Percentage Accept 
' ;’ S:ip^':'fbr Basic Interval 


able j 


Nation 


62(1.4) 


Nation 


68 (2.3) 



k PROFICIENT LEVEti; ' j 

: ! Example Question v • | 


Sybil Sounds the Alarm 


The information about the statue and stamp helps 
to show that 

* A. people today recognize and respect Sybil’s bravery 

B. people were surprised that George Washington honored her 

C. the author included minor details 

D. heroes are honored more now than they were then 


1992 Overall Percentage Correct 


1992; Conditional Percentage Correct ? j 
• j'k- *.■ for Proficient Interval - 


Nation 


62 (1.5) 


Nation 


87 (3.4) 
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FIGURE 3.1 (continued) 

Levels of Reading Achievement at Grade 4 



PROFICIENT LEVEL 

jr Example Question 



Hungry Spider and the Turtle 



What do Turtle’s actions at Spider’s house tell 
you about Turtle? 



Acceptable responses provided a description of Turtle that is consistent 
with the traits portrayed by the character in a specific part of the story. 



1994 Overall Percentage Acceptable 



1994 Conditional Percentage Acceptable | 
for Proficient Interval ~;4 



Nation 


41 (1.4) 


Nation 


64 (3.0) 




|j ADVANCED LEVEL 
K |?f Example Question v 


Sybil Sounds the Alarm 


How does the author show the excitement ar 
danger of Sybil’s ride? 


id 










Acceptable responses described a specific element of the author’s portrayal 
of Sybil that contributed to the story’s atmosphere and tone. 


] 1992 Overall Percentage Acceptable 


1992 Conditional Percentage Acceptable ;§ 
for Advanced Interval 1 


Nation 


44 (1.7) 


Nation 


83 (4.9) 
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FIGURE 3.1 (continued) 

Levels of Reading Achievement at Grade 4 



1994 Trial State Assessment 



ADVANCED LEVEL 
H Example Question jvt 



• i- 



Hungry Spider and the Turtle 



Think about Spider and Turtle in the story. 
Pick someone you know, have read about, 
or have seen in the movies or on television 
and explain how that person is like either 
Spider or Turtle. 



Responses that were rated as Essential or better demonstrated adequate 
understanding of the character of Spider or Turtle by providing any 
story-supported character trait and relating or linking that trait to a real 
world person or character. 



1994 Overall Percentage Essential 
or Better 






1994 Conditional Percentage Essential f 
or Better for Advanced Interval 1 



Nation 



29 (1.3) 



Nation 



73 (8.6) 
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Table 3.1 provides the percentage of fourth-grade public school students at or 
above each achievement level, as well as the percentage of students below the Basic 
level. 



1994, Public School Students 

The percentage of public school students in Louisiana who were at or 
above the Proficient level (15 percent) was lower than that of students 
across the nation (28 percent). 

1992 vs 1994, Public School Students 
From 1992 to 1994, there was no significant change in the percentage 
of public school students in Louisiana who attained the Proficient level 
(15 percent in 1992 and 15 percent in 1994). Similarly, there was no 
significant change in the percentage of public school students across the 
nation who attained the Proficient level (27 percent in 1992 and 
28 percent in 1994). 
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TABLE 3.1 

Levels of Fourth-Grade Public School Students 9 
Reading Achievement 



1994 Trial State Assessment 


At or Above 
Advanced 


At or Above 
Proficient 


At or Above 
Basic 


Below 

Basic 










Percentage 




1992 Public 




^ -xl. $u: 


v,. 1 <: v*-> ' 




Louisiana 




V|-U 15 < T.1) . 


nri;|l| : .46(i;6) • 


54 ( 1.6) 


Southeast 


4(0.8); 


22 ( 2.6) 




45 ( 3.5) ' 


Nation 


' -y 6( 0.6)iH£-. . - 


27 ( T .3) . : 


M.i) . . 


40(1.1) 


1994 Public 




ijl- : ; ; ; .■< i . : 






Louisiana 


2*0-5)^ V 


is 


...^;S&40( 1.5) 


: 6o ( 


Southeast 


•6(a6)fev 


( 2.1 )';>•" V 




'• 47 (2.4) • 


Nation 




r- 28 ( 1 2Y . 7 




: 41 ( i:i) ! 



The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). If the notation 
> (<) appears, it signifies that the value for public school students in 1994 was significantly higher (lower) than the value 
for 1992 at about the 95 percent confidence level. 
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Many students in Louisiana were unable to meet the Proficient achievement level 
that represents solid academic performance in reading. Educators and policy makers 
will need to look to many sources of information and opinion for explanations of these 
levels of achievement. Among the possible explanations, several factors should not be 
overlooked. First, students may not be learning enough in school to reach the 
achievement levels. In 1983, the National Commission on Excellence in Education 
warned that “the educational foundations of our society are being eroded by a rising tide 
of mediocrity that threatens our very future.” 30 In 1990, the president and the governors 
committed the nation to six goals for education, the third of which called for American 
students to “leave grades four, eight and twelve having demonstrated competency in 
challenging subject matter.” 31 Many political leaders of this nation continue to express 
dissatisfaction with the performance of American students. These NAEP findings 
confirm that a great many American students are not yet performing at high levels. 

Second, some students may not be reaching the higher achievement levels because 
schools may not be teaching the elements of reading that are included on the NAEP 
assessment, and because the assessment may not be covering some elements of reading 
included in the school curriculum. No assessment or test can cover all the different areas 
of reading that are taught in school. The content coverage of the NAEP reading 
assessment was set by a consensus approach. Teachers, curriculum specialists, subject 
matter specialists, local school administrators, parents, and members of the general 
public actively participated in deciding what are the most important elements of reading 
to be included in the assessment and for students to learn. 32 

Third, the Basic, Proficient, and Advanced achievement levels reflect high 
standards for the 1994 NAEP reading scale. The establishment of achievement levels 
depends on securing a set of informed judgments of expectations for student educational 
achievement and on summarizing the individual ratings into collective judgments. These 
expectations reflect the Board’s policy definitions, which require that students at the 
central, Proficient level demonstrate “competency over challenging subject matter.” The 
resulting standards are rigorous. 

As measures of performance, both average proficiency scores and percentages of 
students who score at or above the critical achievement levels on the NAEP scale 
provide a valuable overall depiction of students’ reading ability. 




0 National Commission on Excellence in Education. A Nation at Risk. (Washington. DC: U.S. Department of 
Education, 1983). In 1988, then-Secretary Bennett reported that the “precipitous downward slide of previous decades 
has been arrested, and we have begun the long climb back to reasonable standards.” (p. 1 in American Education: 
Making it Work. (Washington, DC: U.S. Department of Education, 1988).). 

31 U.S. Department of Education. America 2000: An Education Strategy. (Washington, DC: U.S. Department of 
Education, 1991). 

32 NAEP Reading Consensus Project. Reading Framework for the 1992 and 1994 National Assessment of Educational 
Progress. (Washington, DC: National Assessment Governing Board, U.S. Department of Education, 1994). 
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CHAPTER 4 



Reading Achievement of Fourth-Grade 
Students by Subpopulations 

Assessment results repeatedly show differences in performance for subpopulations 
of students. 33 This chapter presents achievement level results for subgroups of public 
school students from Louisiana defined by race/ethnicity, type of location, level of 
parents’ education, and gender. Also, results are presented for non-public school 
students and for the combined public and non-public school populations. 

Race/Ethnicity 

Table 4.1 provides the percentage of public school students at or above each of 
the three achievement levels and also the percentage below the Basic level for White, 
Black, and Hispanic students. 

1994 , Public School Students 

In 1994, the percentage of White students in Louisiana who attained the 
Proficient level was greater than that of Black and Hispanic students. 

1992 vs 1994, Public School Students 
There was no significant change between 1992 and 1994 in the 
percentage of White, Black, and Hispanic public school students in 
Louisiana who performed at or above the Proficient level. 



61 

33 Ina V.S. Mullis, John A. Dossey, Jay R. Campbell, Claudia A. Gentile, Christine O’Sullivan, and Andrew S. Latham. 
NAEP 1992 Trends in Academic Progress. (Washington, DC: National Center for Education Statistics, 1994). 
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TABLE 4.1 

Levels of Fourth-Grade Public School Students’ 
Reading Achievement by Race/Ethnicity 




White 

1992 Louisiana 
Southeast 
Nation 

1994 Louisiana 
Southeast 
Nation 

Black 

1992 Louisiana 
Southeast 
Nation 

1994 Louisiana 
Southeast 
Nation 

Hispanic 

1992 Louisiana 
Southeast 
Nation 

1994 Louisiana 
Southeast 
Nation 



The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). If the notation 
> (<) appears, it signifies that the value for public school students in 1994 was significantly higher (lower) than the value 
for 1992 at about the 95 percent confidence level. ! Interpret with caution — the nature of the sample does not allow 
accurate determination of the variability of this statistic. 
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Type of Location 

Table 4.2 presents reading performance by achievement levels for fourth-grade 
students attending public schools in central cities, urban fringe/large towns, and rural 
areas/small towns. 



1994, Public School Students 

In Louisiana, the percentage of students attending public schools in 
central cities who attained the Proficient level was not significantly 
different from that of students in urban fringe/large towns or rural 
areas/small towns. 

1992 vs 1994, Public School Students 
From 1992 to 1994, there was no significant change in the percentage 
of students attending public schools in central cities, urban fringe/large 
towns, or rural areas/small towns in Louisiana who attained the 
Proficient level. 
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TABLE 4.2 

Levels of Fourth-Grade Public School Students 9 
Reading Achievement by Type of Location 



1994 Trial State Assessment 


At or Above At or Above 

Advanced Proficient 


At or Above Below 

Basic Basic 


Central City 
1992 Louisiana 
Nation 

1994 Louisiana 
Nation 

Urban Fringe/Large Town 
1992 Louisiana 
Nation 

1994 Louisiana 
Nation 

Rural/Small Town 
1992 Louisiana 
Nation 

1994 Louisiana 
Nation 


/ ^ Percentage 

3 ( 0.6) 15 ( 2 4) 42 ( 3 3) 58 ( 3.3) 

tilt ip mm $m •• is i m t#si i ss®®* 

8(1.1} 33(2.0) 65(1.8) 35(1.8) 

2(0.7) IS (1.7) 45 ( 2.7) 55 ( 2.7) 

5(1.5) : 1 



School sample size is insufficient to permit reliable regional results for type of location. 

The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). If the notation 
> (<) appears, it signifies that the value for public school students in 1994 was significantly higher (lower) than the value 
for 1992 at about the 95 percent confidence level. 
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Parents’ Education Level 

Table 4.3 shows the reading achievement level results for fourth-grade public 
school students who reported that at least one parent graduated from college, at least 
one parent had some education after high school, at least one parent graduated from high 
school, neither parent graduated from high school, or they did not know their parents’ 
education level. 



1994 y Public School Students 

In Louisiana, the percentage of students reporting that at least one parent 
graduated from college who performed at or above the Proficient level 
was not significantly different from that of students who reported that 
at least one parent had some education after high school or at least one 
parent graduated from high school but was larger than that of students 
who reported that neither parent graduated from high school or they did 
not know their parents’ education level. 

1992 vs 1994 y Public School Students 
The percentage of public school students in Louisiana who reported that 
at least one parent graduated from college, at least one parent had some 
education after high school, at least one parent graduated from high 
school, neither parent graduated from high school, or they did not know 
their parents’ education level who attained the Proficient level did not 
change significantly between 1992 and 1994. 
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TABLE 4.3 

Levels of Fourth-Grade Public School Students’ 
Reading Achievement by Parents’ Level of Education 



1994 Trial State Assessment 



At or Above 
Advanced 



At or Above 
Proficient 



At or Above 
Basic 



Below 

Basic 



College graduate 
1992 Louisiana 
Southeast 
Nation 

1994 Louisiana 
Southeast 
Nation 

Some education after HS 
1992 Louisiana 
Southeast 
Nation 

1994 Louisiana 
Southeast 
Nation 

High school graduate 
1992 Louisiana 
Southeast 
Nation 

1994 Louisiana 
Southeast 
Nation 

High school non-graduate 
1992 Louisiana 
Southeast 
Nation 

1994 Louisiana 
Southeast 
Nation 

I don’t know 
1992 Louisiana 
Southeast 
Nation 

1994 Louisiana 
Southeast 
Nation 



F^rcentage 



II liil! ||| lliili |t!| | 

3(1.0) 

tillgs;.pi2) f“* 



iB«|§l9p 

r 31 {3ie)il 

10(1.2) 36(2.0) 

■ ' ■ 
4(1.0) 18(2.0) 

9 ( 13) 31(23) 



i l lt lllil 

50(2.8) 
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liliiiiiii 

4(2.2) 

r;' ( 2.3) 

iiiiiiiliii! 
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26(2.6) 

28(5.0) 

ijllljf 32 ( 3*6)1! 

24(33) 
36 ( 3.7) 



44 ( 2.7) 56 ( 2.7) 

60 ( 3.7) 40 ( 3.7) 

68 ( 1.5) 32(15) 

59(3.4) 41 (3.4) 

61 (7.1) 39(7.1) 

55 ( ? at 45 r 2 m 






Mfi 

12(17): 
| a 2 ( 1 .6):; m ' || 18 ( 4.2) 

3(1.1) 21(2.3) 
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4(1.5) 19(4.2) 

4(1.3) 22(2.7) 
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42 ( 2.0) 58 ( 2.0) 

50 ( 4.9) 50 ( 45) 
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The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). If the notation 
> (<) appears, it signifies that the value for public school students in 1994 was significantly higher Gower) than the value 
for 1992 at about the 95 percent confidence level. 
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Gender 

Table 4.4 provides the achievement level results by gender for fourth-grade public 
school students. 



1994, Public School Students 

The percentage of males in Louisiana public schools who attained the 
Proficient level was not significantly different from that of females. 

1992 vs 1994, Public School Students 
There was no significant change in the percentage of males who 
performed at or above the Proficient level from 1992 to 1994. Similarly, 
there was no significant change in the percentage of females who were 
at or above the Proficient level from 1992 to 1994. 
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TABLE 4.4 

Levels of Fourth-Grade Public School Students y 
Reading Achievement by Gender 



1994 Trial State Assessment 




The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). If the notation 
> (<) appears, it signifies that the value for public school students in 1994 was significantly higher (lower) than the value 
for 1992 at about the 95 percent confidence level. 
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Reading Achievement of Non-Public School Students 

Table 4.5 provides the percentage of fourth-grade students at or above each 
achievement level for the non-public school and combined populations. Trend results 
are not presented for non-public school students because they were not included in the 
1992 samples. 



1994, Non-Public School Students 

The percentage of non-public school students in Louisiana who were at 
or above the Proficient level (38 percent) did not differ significantly 
from that of students across the nation (43 percent). 

Public and Non-Public School Student Comparison 
The percentage of non-public school students in Louisiana who were at 
or above the Proficient level (38 percent) was higher than that of public 
school students (15 percent). For the nation, the percentage of 
non-public school students who attained the Proficient level 
(43 percent) was higher than that of their public school counterparts 
(28 percent). 

1994, Public and Non-Public School Students Combined 
The percentage of students in Louisiana who were at or above the 
Proficient level (19 percent) was lower than that of students across the 
nation (30 percent). 
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TABLE 4.5 

Levels of Fourth-Grade Students’ Reading 
Achievement, Non-Public and Combined Schools 



1994 Trial State Assessment 



1994 Non-Public 

Louisiana 

Southeast 

Nation 

1994 Combined 

Louisiana 

Southeast 

Nation 



Percentage 




At or Above 
Basic 



(#S2I®5.1):«2 

WEm&SS&i 
' ' ' - - 

|| 60 .X 1 . 0 )|I 



Below 

Basic 



' ' 

27(4.1) 

8£Si& its®*: 

54 (1.6) 



: N 



The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). 
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PART THREE 



Finding a Context for Understanding 
Students’ Reading Proficiency in Public 
Schools 

Information on the reading proficiency of students in Louisiana can be better 
understood and used for improving instruction and setting policy when supplemented 
with contextual information about schools, teachers, and students. 

To gather contextual information, the fourth-grade students participating in the 
1994 Trial State Assessment Program, their reading teachers, and the principals or other 
administrators in their schools were asked to complete questionnaires on instruction, 
programs, and policies. The student, teacher, and school data help to describe some of 
the current practices in reading education, to illuminate some of the factors that appear 
to be related to fourth-grade public school students’ reading proficiency, and to provide 
an educational context for understanding information on student achievement. 

It is important to note that the NAEP data cannot establish cause-and-effect links 
between various contextual factors and students’ reading proficiency. However, the 
results do provide information about important relationships between the contextual 
factors and proficiency. Through the questionnaires administered to students, teachers, 
and principals, NAEP is able to provide a broad picture of educational practices 
prevalent in American schools and classrooms. 
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In order to improve and refine the NAEP questionnaires, some questions are 
revised and/or reformatted between assessments. Although this allows for more precise 
and relevant data collection, it makes the reporting of trend results on those particular 
questions at best difficult to interpret and at worst, impossible to accomplish. Some of 
the questions reported on in Chapters 5 through 7 were revised and/or reformatted for 
the 1994 assessment. In some cases the revisions, though relatively minor, were of 
sufficient magnitude to make comparisons with 1992 results difficult to interpret. For 
these questions, the results for both 1992 and 1994 are reported; however, no statistical 
comparisons were made, and changes from 1992 to 1994 are not discussed. Questions 
thus affected are indicated in the tables and the reader is cautioned to keep these question 
changes in mind when comparing 1992 and 1994 results. For other questions, 
substantial revisions make comparison to 1992 results unwise or impossible. For these 
questions, no 1992 data are reported. 

Part Three consists of four chapters. Chapter 5 discusses policies and practices 
related to reading. Chapter 6 focuses on instructional approaches — how instruction is 
delivered. Chapter 7 provides information about teachers, and Chapter 8 examines 
students’ home support for literacy. 
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CHAPTER 5 



Policies and Practices Related to Reading 

This chapter focuses on curricular and instructional content issues in Louisiana 
public schools and their relationship to students’ reading proficiency. Table 5.1 
provides a profile of the reading policies and practices in the public schools with fourth 
grades in Louisiana. Some of the selected results obtained from teacher and school 
questionnaires reveal: 

• According to the public school administrators in Louisiana in 1994, 

92 percent of the fourth-grade students were in schools where reading 
was identified as receiving special emphasis. This percentage was not 
significantly different from* that of students across the country 
(85 percent). 

• In 1994, according to their reading teachers, 19 percent of the students 
in public schools in Louisiana were typically taught reading in a class 
that was grouped by reading ability. The prevalence of ability grouping 
was not significantly different across the nation (22 percent). 



rs 



0 



* Although the difference may appear large, recall that “significance” here refers to “statistical significance.” (See 
Appendix A for further discussion.) 
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TABLE 5.1 

Reading Policies and Practices in Fourth-Grade Public 
Schools 



1994 Trial State Assessment 


Louisiana 


Southeast 


Nation 








Percentage 
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Percentage of students in public schools that identified 


rv idik y ! T tp : '- 


J ' < '' i '' 


y? A -i - 


reading as a priority in school wide goals and objectives, 




V : j y Jy f y s i. ' Vf ; ' \f 
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instruction, workshops, etc.* 




sir 1 } 


yj 1 : :v- 


1992 


ii 


y 88 ( 4.9) t "A 


111186 


1994 


|j 






Percentage of students in public schools who are assigned 








to a reading class by their ability* 


'i KtJ' s 4 ^ aW 






1992 


•^20(4.0) Sit 


!p::il32'^55);'1'y.. 


34 (4.1) 


1994 


19 ( 2.7) 


-i8H.4j: 


22(^9) 


Percentage of students in public schools who stay with the 


f r. ,-** ; \ A 


’A' j; 4 * .' • 


' 


same teacher for all academic subjects 




; I-.' - 1 ! ^ 


- 


1992 


lSilS3'(4-5) V-0 


A4iA2\AA)’%t 


48 { 3.6) . 


1994 


|BSg :(&2) 


59 ( 8.3) 

y^'-c \ j Vy. 


57(4:1) 


Percentage of students in public schools who remain with 




illiiiil IP.t 


/• ’itfeysa 


one teacher for most subjects but may have a different 








teacher for one or two subjects 




y > < 


: ,, a* y -a r 


1992 


!i 82^4:3); 


l : mejsiy& 


; : 42 ( 33)' r 


1994 


IS ! MMtM 


26 ( 6.4) , 


37(4.0) 


Percentage of students in public schools in which a reading 






AAAyAAA^A/AyyyAA- 


curriculum specialist is available to help or advise 






A 7 111 11- 


1992 


4A) i&f 




# ! 64 ( 32);/. | 


1994 


63(4.1) 


; 


67(2.9) 


Percentage of students in public schools that use parents 


illiliiliiilll 


"/i' V /'( 7 fit SI! 




as aides in classrooms 




/y ( t / * ; *. ’ ' z 


, 


1992 


85 ( 3.6) 


90 < 6 . 9 ) ; 


89 ( 2.6) 


1994 


87 ( 3.2) 


||§||||§p|)0) , 





* The question associated with this variable was reformatted in 1994. No trend comparison tests were conducted. 

The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). If the notation 
> (<) appears, it signifies that the value for public school students in 1994 was significantly higher (lower) than the value 
for 1992 at about the 95 percent confidence level. 
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Time for Instructional Activities 

To begin to place students’ reading proficiency in context, it is useful to examine 
the extent to which fourth-grade students’ reading teachers in Louisiana are spending 
their time on instructional activities. Teachers of the assessed students were asked to 
report on the amount of time they spent with each class for reading instruction on a 
typical day. Table 5.2 shows the results for public school students. 34 

• In 1994, the percentage of students in Louisiana who had reading 
teachers who spent 60 minutes providing reading instruction each day 
(67 percent) was larger than that across the nation (44 percent). 

• In Louisiana in 1994, average reading proficiency was higher for 
students whose teachers spent 60 minutes on reading instruction than for 
students whose teachers spent 45 minutes or less on reading instruction 
each day. 




TABLE 5.2 

Public School Teachers 9 Reports on Time Spent 
Teaching Reading 



1994 Trial State Assessment 



Louisiana 



Southeast 



Nation 



About how much time do you spend for 
reading instruction on a typical day?* 

45 minutes or less 
1992 

1994 

60 minutes 
1992 

1994 

90 minutes or more 
1992 

1994 



Percentage and Proficiency 



? : . 205 ( 2,5)K?;;is 

190 ( 3.9) 



wm msm 

■m 67 



■: & -A 'A Att >:& 5 ; '& 



jj 

'<§216 { Z2) ’ 

" jfc* > '"-r > * *4; 

37 {as> 

liaBi 
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VMM. IPS. 



WO2^SS0SM 

(■?&§ jt-Tfl 

'/ J'' 

,P:-211 ( 7.0) ■ * „ 

:r: * msam t%m. Mm 






* w!' : ' v , 

29 < 3.2} 



217(1.8) 







* The question associated with this variable was reformatted in 1994. No trend comparison tests were conducted. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. 




34 

For every table in the body of the report that includes estimates of average proficiency, the Data Appendix provides 
a corresponding table presenting the results for the four subpopulations — race/ethnicity, type of location, parents’ 
education level, and gender — as well as by school type. 
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Instructional Resources for Reading 

Teachers’ use of resources is obviously constrained by the availability of those 
resources. Thus, the assessed students’ teachers were asked about the extent to which 
they were able to obtain all of the instructional materials and other resources they 
needed. From Table 5.3: 

• In 1994, the percentage of fourth-grade students in public schools in 
Louisiana who were being taught by teachers who reported getting all 
of the resources they needed (12 percent) did not differ significantly 
from the corresponding percentage of students across the nation 
(9 percent). 

• Furthermore, in 1994, the percentage of public school students in 
Louisiana whose teachers got only some or none of the resources they 
needed (39 percent) did not differ significantly from that of students 
across the nation (35 percent). 

• In 1994, public school students in Louisiana whose teachers got all of 
the resources they needed had an average reading proficiency (202) 
which was not significantly different from* that of students whose 
teachers got only some or none of the resources they needed (192). 

• From 1992 to 1994, there was no significant change in the percentage 
of students in Louisiana whose teachers reported getting all of the 
resources they needed. There was a decrease in the percentage of 
students whose teachers got only some or none of the resources they 
needed during this same time. 




* Although the difference may appear large, recall that “significance” here refers to “statistical significance.” (See 
Appendix A for further discussion.) 
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TABLE 5.3 

Public School Teachers’ Reports on the Availability 
of Resources 



1994 Trial State Assessment 


Louisiana 


Southeast 


Nation 


Which of the following statements is true 
about how well your school system 
provides you with the instructional 
materials and other resources you need 
to teach your class? 

1 get all the resources 1 need. 

1992 

1994 

1 get most of the resources 1 need. 

1992 

1994 

1 get some or none of the resources 1 need. 

1992 

1994 


; J;! U Pern 
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40 ( 39) 
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11 ( 1.7) 

!g;:2220( ? 3:1) ' l . 

■ 51 ( 2.9) 

' 216(1.7) 

' 

55(2.7) 

(15) 

; . | 

39 ( 3.5) -V, 

213(1.6, 

: : ;-.-|35(.2.7) 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. ! Interpret 
with caution — the nature of the sample does not allow accurate determination of the variability of this statistic. 
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CHAPTER 6 



How Is Reading Instruction Delivered? 

Effective classroom instruction can help students become thoughtful readers. 35 
The instructional activities that students complete can also lead them to view reading in 
particular ways 36 and to focus their efforts on developing certain skills and strategies. 
To provide information about how instruction is delivered in Louisiana, fourth-grade 
students participating in the Trial State Assessment Program and their reading teachers 
were asked to report on the use of various teaching and learning activities in their 
reading classrooms. 

Instructional Materials for Reading 

Basal reading programs are a traditional part of reading instruction in this country. 
They typically include a compilation of reading passages and exercises, as well as 
ancillary materials, such as workbooks and tests. These types of programs account for 
at least two-thirds of all expenditures for reading instruction and are used in more than 
95 percent of all school districts through grade 6. 37 However, other types of reading 
programs may utilize trade books, such as story or informational books, that are not 
necessarily published for the sole purpose of reading instruction. When students 
encounter a variety of texts, they expand their general understanding of language, as 
well as their understanding of text and its underlying structures. 38 To provide 
information about instructional materials used for fourth-grade classes, students’ reading 
teachers were asked to report about the type of materials that formed the core of their 
reading program. Table 6.1 provides the results. 



35 A.P. Sweet Transforming Ideas for Teaching and Learning to Read. (Washington, DC: Office of Educational 
Research and Improvement, 1993). 

36 J.A. Dole, G.G. Duffy, L.R. Roehler, and P.D. Pearson. “Moving from the Old to the New: Research on Reading 
Comprehension Instruction,” in Review of Educational Research ; 61. (1991). pp. 239-264. 

37 Jeanne S. Chall and James R. Squire. “The Publishing Industry and Textbooks,” in R. Barr, M. Kamil, P. Mosenthal, 
and P.D. Pearson, Eds., Handbook of Reading Research, Volume II. (New York, NY: Longman, 1991). 



38 

V. J. Harris. “Literature-Based Approaches to Reading Instruction,” in Review of Research in Education. (Washington, 
DC: American Educational Research Association, 1993). 
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According to Louisiana public school reading teachers, in 1994: 

• Students in Louisiana whose teachers used both basal and trade books 
demonstrated an average reading proficiency (195) which did not differ 
significantly from that of students whose teachers primarily used basal 
readers (199). 
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TABLE 6.1 

Public School Teachers 9 Reports on Instructional 
Materials for Reading 



1994 Trial State Assessment 


Louisiana Southeast 


Nation 


What type of materials form the 
core of your reading program ?* 

Primarily basal 

1992 

1994 

Primarily trade books 

1992 

1994 

Both basal and trade books 

1992 

1994 

Other 

1992 

1994 


Percentage and Proficiei 

67 <3.6) 45,4.8) 
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* The question associated with this variable was reformatted in 1994. No trend comparison tests were conducted. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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Teachers were also asked about their use of specific types of resources that can 
add depth and variety to the reading program (Table 6.2). Some selected results for 
public school students reveal that, in 1994: 

• In Louisiana, 23 percent of the fourth-grade students had reading 
teachers who used children’s newspapers and/or magazines at least once 
a week. This percentage was not significantly different from* that for 
the nation (30 percent). 

• The percentage of Louisiana students who had reading teachers who 
used reading kits at least once a week (34 percent) was greater than that 
for students in the nation (21 percent). 

• The percentage of students in Louisiana who had reading teachers who 
used computer software for reading instruction at least once a week 
(33 percent) was greater than that for the nation (24 percent). 

• In Louisiana, 50 percent of the students had reading teachers who used 
a variety of books at least once a week. This figure was smaller than 
that for students across the nation (75 percent). 

• The percentage of students in Louisiana who had reading teachers who 
used materials from other subject areas at least once a week (54 percent) 
was smaller than that for the nation (69 percent). 



* Although the difference may appear large, recall that “significance” here refers to “statistical significance.” (See 
Appendix A for further discussion.) 
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TABLE 6.2 

Public School Teachers’ Reports on Resources for 
Reading Instruction 



1994 Trial State Assessment 










Louisiana 


Southeast 


Nation 


How often do you use the following 


M Percentage and Proficiency ' 


resources to teach reading?* 
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Reading kits 
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Computer software for reading instruction 
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(continued on next page) 
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TABLE 6.2 (continued) 

Public School Teachers’ Reports on Resources for 
Reading Instruction 



1994 Trial Slate Assessment 



Louisiana 



Southeast 



Nation 



How often do you use the following 
resources to teach reading?* 

Materials from other subject areas 
At least once a week 1992 

1994 

Once or twice a month 1992 

1994 

Never or hardly ever 1992 

1994 



:Ui '.Vr' ‘V’ Percentage and i Proficiency V 




* The question associated with this variable was reformatted in 1994. No trend comparison tests were conducted. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. 



Instructional Activities 

Teachers can nurture students’ developing reading ability by providing 
instructional activities that prepare students for a wide variety of specific reading 
tasks . 39 Effective activities support students’ understanding of the text being read and 
model the ways in which students can control the process of building meaning when 
reading on their own . 40 To provide information about the instructional activities in 
which fourth-grade students are engaged, the students participating in the Trial State 
Assessment Program and their reading teachers were asked to report on the frequency 
with which the teachers asked the students to do a variety of activities. The students’ 
and teachers’ responses are presented in the three following sections — workbooks, 
worksheets, and writing; discussions and group activities; and time to read. The 
students’ and teachers’ responses sometimes reflect different perceptions of the 
frequency of some activities. 



39 S.G. Paris. ‘Teaching Children to Guide Their Reading and Learning,” in Taffy E. Raphael, Ed., The Contexts of 
School-Based Literacy. (New York, NY: Random House, 1984). pp. 115-130. 

40 A.P. Sweet Transforming Ideas for Teaching and Learning to Read . (Washington, DC: Office of Educational 
Research and Improvement, 1993). 
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Workbooks, Worksheets, and Writing 



Some educators and researchers have suggested that children spend a 
disproportionate amount of time completing workbook tasks rather than receiving 
reading instruction or actively constructing their own understandings. 41 Analyses of 
workbook and worksheet activities reveal that many of these tasks require only a 



constitute time spent on workbooks and worksheets, such tasks rarely require students 
to engage in any extended writing. Writing activities have been found to incite 
children’s interest and involvement in learning about language and to enhance their 
reading comprehension. 43 To examine the use of workbooks, worksheets, and the 
reading/writing connection, students and their reading teachers were asked about the 
frequency with which teachers asked students to work in a reading workbook or on a 
worksheet or to write about something they had read. Table 6.3 provides these results. 

In 1994, according to the fourth-grade public school students in Louisiana: 

• The percentage of students who were asked to work in a reading 
workbook or on a worksheet almost every day (57 percent) was greater 
than the percentage of students who were asked to write about 
something they have read almost every day (24 percent). 

• Students who were asked to work in a reading workbook or on a 
worksheet almost every day demonstrated an average reading 
proficiency (200) which was higher than that of students who did this 
activity less than weekly (185). 

• The average reading proficiency of students who were asked to write 
about something they have read almost every day (190) was lower than 
that of students who were asked to do this less than weekly (202). 

And, according to their reading teachers: 

• The percentage of students who were asked to work in a reading 
workbook or on a worksheet almost every day (36 percent) was greater 
than the percentage of students who were asked to write about 
something they have read almost every day (15 percent). 



1 P.D. Pearson, L.R. Roehler, J.A. Dole, and G.G. Duffy. “Developing Expertise in Reading Comprehension,” in S.J. 
Samuels and A.E. Farstrup, Eds., What Research Has to Say About Reading Instruction . (Newark, DE: International 
Reading Association, 1992); R.C. Anderson, E.H. Hiebert, J.A. Scott, and I.A.G. Wilkinson. Becoming a Nation of 
Readers: The Report of the Commission on Reading . (U.S. Department of Education: The National Institute of 
Education, 1985). 

42 J.R. Campbell, B.A. Kapinus, and A.S. Beatty. Interviewing Children About Their Literacy Experiences. (Washington, 
DC: National Center for Education Statistics, Government Printing Office, 1995); J. Osborn. “Workbooks: Counting, 
Matching, and Judging,” in J. Osborn, P.T. Wilson, and R.C. Anderson Eds., Reading Education: Foundations for a 
Literate America. (Lexington, M A: Lexington Books, 1985). 

43 S.D. Miller, T. Adkins, and M.L. Hooper. “Why Teachers Select Specific Literacy Assignments and Students’ 
Reactions to Them,” in Journal of Reading Behavior, 25(1), 69-93. 1993; D.C. Simmons, E.J. Kameeuni, S. Dickson, 
D. Chard, B. Gunn, and S. Baker. “Integrating Narrative Reading Comprehension and Writing Instruction for All 
Learners,” in Multidimensional Aspects of Literacy Research , Theory, and Practice. (Chicago, IL: National Reading 
Conference, 1994). 



perfunctory level of reading. 42 Although we do not know what specific activities 
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